Sep 29 18:29:45 devstack cinder-volume[75584]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 18:29:45 devstack cinder-volume[75584]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 18:29:45 devstack cinder-volume[75584]: we strongly recommend against using it for new projects. Sep 29 18:29:45 devstack cinder-volume[75584]: If you are already using Eventlet, we recommend migrating to a different Sep 29 18:29:45 devstack cinder-volume[75584]: framework. For more detail see Sep 29 18:29:45 devstack cinder-volume[75584]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 18:29:45 devstack cinder-volume[75584]: import eventlet # noqa Sep 29 18:29:47 devstack cinder-volume[75584]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75584) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:29:47 devstack cinder-volume[75584]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75584) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:29:47 devstack cinder-volume[75584]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75584) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:29:48 devstack cinder-volume[75584]: INFO dbcounter [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Registered counter for database cinder Sep 29 18:29:49 devstack cinder-volume[75584]: DEBUG oslo_db.sqlalchemy.engines [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75584) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:29:49 devstack cinder-volume[75584]: DEBUG dbcounter [-] [75584] Writer thread running {{(pid=75584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 18:29:49 devstack cinder-volume[75584]: INFO cinder.rpc [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 18:29:49 devstack cinder-volume[75584]: INFO cinder.rpc [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 18:29:49 devstack cinder-volume[75584]: DEBUG oslo_db.sqlalchemy.engines [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75584) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:29:49 devstack cinder-volume[75584]: INFO cinder.volume.manager [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Determined volume DB was empty at startup. Sep 29 18:29:49 devstack cinder-volume[75584]: DEBUG cinder.volume.manager [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75584) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Sep 29 18:29:49 devstack cinder-volume[75584]: INFO cinder.volume.manager [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 29 18:29:49 devstack cinder-volume[75584]: WARNING stevedore.named [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 18:29:49 devstack cinder-volume[75584]: WARNING castellan.key_manager [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:29:49 devstack cinder-volume[75584]: WARNING cinder.keymgr.conf_key_mgr [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:29:49 devstack cinder-volume[75584]: DEBUG cinder.volume.drivers.lvm [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75584) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 29 18:29:49 devstack cinder-volume[75584]: DEBUG oslo_concurrency.processutils [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_concurrency.processutils [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] CMD "cinder-rtstool verify" returned: 0 in 0.411s {{(pid=75584) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_db.sqlalchemy.engines [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75584) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:29:50 devstack cinder-volume[75584]: INFO cinder.rpc [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 29 18:29:50 devstack cinder-volume[75584]: INFO cinder.rpc [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 29 18:29:50 devstack cinder-volume[75584]: WARNING stevedore.named [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 18:29:50 devstack cinder-volume[75584]: WARNING castellan.key_manager [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:29:50 devstack cinder-volume[75584]: INFO cinder.volume.manager [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_db.sqlalchemy.engines [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75584) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:29:50 devstack cinder-volume[75584]: INFO oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Starting 1 workers Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Started child 75744 {{(pid=75584) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Full set of CONF: {{(pid=75584) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] ******************************************************************************** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Configuration options gathered from: {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] ================================================================================ {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] allow_availability_zone_fallback = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] allow_compression_on_image_upload = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] allowed_direct_url_schemes = [] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] api_rate_limit = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] auth_strategy = keystone {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75744]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] az_cache_duration = 3600 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_availability_zone = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_host = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_name = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_stats_polling_interval = 60 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backup_api_class = cinder.backup.api.API {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backup_name_template = backup-%s {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backup_use_same_host = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backup_use_temp_snapshot = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] chap_password = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] chap_username = {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cinder_internal_tenant_project_id = 40ccd4467cfd467390acfcf5c322022f {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cinder_internal_tenant_user_id = a667b24308cb4b04a28e368ff3143453 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cloned_volume_same_az = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cluster = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] compression_format = gzip {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] compute_api_class = cinder.compute.nova.API {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] config_dir = [] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] config_source = [] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] control_exchange = openstack {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] debug = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] default_availability_zone = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] default_group_type = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] default_volume_type = lvmdriver-1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] disk_geometry = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] driver_client_cert = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] driver_client_cert_key = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] driver_data_namespace = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] driver_ssl_cert_path = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] driver_ssl_cert_verify = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] driver_use_ssl = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] enable_force_upload = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] enable_new_services = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] enable_unsupported_driver = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] enforce_multipath_for_image_xfer = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] filter_function = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance_api_insecure = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance_api_ssl_compression = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance_ca_certificates_file = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance_catalog_info = image:glance:publicURL {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance_certfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance_keyfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance_num_retries = 3 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance_request_timeout = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] goodness_function = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] graceful_shutdown_timeout = 5 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] group_api_class = cinder.group.api.API {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] host = devstack {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] image_compress_on_upload = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] image_conversion_address_space_limit = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] image_conversion_cpu_limit = 60 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] image_conversion_disable = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] image_introspection_address_space_limit = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] image_introspection_cpu_limit = 60 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] image_upload_use_cinder_backend = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] image_upload_use_internal_tenant = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] image_volume_cache_enabled = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] image_volume_cache_max_count = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] image_volume_cache_max_size_gb = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] init_host_max_objects_retrieval = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] instance_format = [instance: %(uuid)s] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] iscsi_target_flags = {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] iscsi_write_cache = on {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] iser_helper = tgtadm {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] iser_ip_address = 192.168.122.213 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] iser_port = 3260 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] log_color = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] log_config_append = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] log_dir = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] log_file = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] log_options = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] log_rotate_interval = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] log_rotate_interval_type = days {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] log_rotation_type = none {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75744]: INFO cinder.volume.manager [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 29 18:29:50 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] max_age = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] max_logfile_count = 30 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] max_logfile_size_mb = 200 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] max_over_subscription_ratio = 20.0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] message_reap_interval = 86400 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] message_ttl = 2592000 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] migration_create_volume_timeout_secs = 300 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] monkey_patch = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] monkey_patch_modules = [] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] my_ip = 192.168.122.213 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] no_snapshot_gb_quota = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] num_iser_scan_tries = 3 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] num_shell_tries = 3 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] num_volume_device_scan_tries = 3 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] nvmeof_conn_info_version = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] nvmet_ns_id = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] nvmet_port_id = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] osapi_max_limit = 1000 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] osapi_volume_ext_list = [] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] osapi_volume_listen_port = 8776 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] osapi_volume_use_ssl = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] osapi_volume_workers = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] per_volume_size_limit = -1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] periodic_fuzzy_delay = 60 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] periodic_interval = 60 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] public_endpoint = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] publish_errors = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] quota_backup_gigabytes = 1000 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] quota_backups = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] quota_gigabytes = 1000 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] quota_groups = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] quota_snapshots = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] quota_volumes = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] rate_limit_burst = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] rate_limit_except_level = CRITICAL {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] rate_limit_interval = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] reinit_driver_count = 3 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] replication_device = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] report_discard_supported = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] report_interval = 120 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] reservation_clean_interval = 86400 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] reservation_expire = 86400 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] reserved_image_namespaces = [] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] reserved_percentage = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] rpc_response_timeout = 120 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] run_external_periodic_tasks = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] scst_target_driver = iscsi {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] scst_target_iqn_name = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] service_down_time = 720 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] shell_completion = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] snapshot_name_template = snapshot-%s {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] snapshot_same_host = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] split_loggers = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] state_path = /opt/stack/data/cinder {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] storage_availability_zone = nova {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] storage_protocol = iSCSI {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] syslog_log_facility = LOG_USER {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] target_helper = lioadm {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] target_ip_address = 192.168.122.213 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] target_port = 3260 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] target_protocol = iscsi {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] target_secondary_ip_addresses = [] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] trace_flags = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] transport_url = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] until_refresh = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] use_chap_auth = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] use_default_quota_class = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] use_journal = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] use_json = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] use_multipath_for_image_xfer = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] use_stderr = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] use_syslog = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] verify_glance_signatures = enabled {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] volume_api_class = cinder.volume.api.API {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] volume_backend_name = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.029s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:50 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] volume_clear = zero {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] volume_clear_ionice = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] volume_clear_size = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] volume_copy_bps_limit = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] volume_dd_blocksize = 1M {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] volume_name_template = volume-%s {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] volume_service_inithost_offload = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] volume_usage_audit_period = month {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] zoning_mode = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_concurrency.disable_process_locking = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.auth_section = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.auth_type = password {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.auth_version = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.cache = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.certfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.include_service_catalog = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.insecure = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.interface = public {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.keyfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_password = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcache_username = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.region_name = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.service_type = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.backend = dogpile.cache.null {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.backend_argument = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.backend_expiration_time = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.config_prefix = cache.oslo {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.debug_cache_backend = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.enable_retry_client = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.enable_socket_keepalive = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.enabled = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.expiration_time = 600 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.hashclient_retry_attempts = 2 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.memcache_dead_retry = 300 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.memcache_pool_maxsize = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.memcache_sasl_enabled = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.password = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.proxies = [] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.redis_db = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.redis_server = localhost:6379 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.retry_attempts = 2 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.retry_delay = 0.0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack sudo[75751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 29 18:29:50 devstack sudo[75751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.socket_keepalive_count = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.socket_keepalive_idle = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.socket_keepalive_interval = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.socket_timeout = 1.0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.tls_allowed_ciphers = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.tls_cafile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.tls_certfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.tls_enabled = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.tls_keyfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cache.username = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] coordination.backend_url = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.asyncio_connection = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.asyncio_slave_connection = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.backend = sqlalchemy {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.connection = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.connection_debug = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.connection_parameters = {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.connection_recycle_time = 3600 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.connection_trace = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.db_inc_retry_interval = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.db_max_retries = 20 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.db_max_retry_interval = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.db_retry_interval = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.max_overflow = 50 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.max_pool_size = 5 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.max_retries = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.mysql_wsrep_sync_wait = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.pool_timeout = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.retry_interval = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.slave_connection = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.sqlite_synchronous = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.synchronous_reader = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] database.use_db_reconnect = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_tracing.insecure = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler.connection_string = messaging:// {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler.enabled = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler.es_doc_type = notification {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler.es_scroll_size = 10000 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler.es_scroll_time = 2m {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler.filter_error_trace = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler.hmac_keys = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler.sentinel_service_name = mymaster {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler.socket_timeout = 0.1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler.trace_requests = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler.trace_sqlalchemy = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler_jaeger.process_tags = {} {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler_jaeger.service_name_prefix = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] profiler_otlp.service_name_prefix = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_policy.enforce_new_defaults = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_policy.policy_default_rule = default {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_policy.policy_file = policy.yaml {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] privsep_osbrick.group = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] privsep_osbrick.helper_command = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] privsep_osbrick.user = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cinder_sys_admin.group = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cinder_sys_admin.helper_command = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] cinder_sys_admin.user = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] service_user.auth_section = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] service_user.auth_type = password {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] service_user.cafile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] service_user.certfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] service_user.collect_timing = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] service_user.insecure = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] service_user.keyfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] service_user.send_service_user_token = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] service_user.split_loggers = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] service_user.timeout = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] service_user.tls_ciphers = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] service_user.tls_min_version = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance.auth_section = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance.auth_type = password {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance.certfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance.collect_timing = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance.insecure = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance.keyfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance.region_name = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance.split_loggers = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance.timeout = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance.tls_ciphers = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] glance.tls_min_version = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.backend_availability_zone = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.chap_password = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.chap_username = {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.disk_geometry = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.driver_client_cert = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.driver_client_cert_key = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.driver_data_namespace = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.driver_use_ssl = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.extra_capabilities = {} {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.filter_function = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.goodness_function = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.iscsi_target_flags = {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.iscsi_write_cache = on {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.iser_helper = tgtadm {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.iser_port = 3260 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.lvm_share_target = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.lvm_type = auto {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.num_shell_tries = 3 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.replication_device = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.report_discard_supported = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.reserved_percentage = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.target_helper = tgtadm {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.target_port = 3260 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.target_protocol = iscsi {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.trace_flags = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.unique_fqdn_network = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.use_chap_auth = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.volume_backend_name = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.volume_clear = zero {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.volume_clear_ionice = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.volume_clear_size = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_reports.file_event_handler = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_reports.log_dir = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.backend_host = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.chap_password = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.chap_username = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.disk_geometry = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.driver_client_cert = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.extra_capabilities = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.filter_function = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.goodness_function = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.iser_helper = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.iser_ip_address = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.iser_port = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.lvm_share_target = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.lvm_type = auto {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.num_shell_tries = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.replication_device = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.report_discard_supported = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.reserved_percentage = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.scst_target_driver = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.storage_protocol = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.target_helper = lioadm {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.target_ip_address = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.target_port = 3260 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.trace_flags = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.use_chap_auth = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.volume_clear = zero {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.volume_clear_size = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] lvmdriver-1.volumes_dir = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.ssl = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_notifications.driver = [] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_notifications.retry = -1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] key_manager.fixed_key = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.barbican_api_version = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.barbican_endpoint = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.barbican_endpoint_type = public {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.barbican_region_name = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.cafile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.certfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.collect_timing = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.insecure = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.keyfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.number_of_retries = 60 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.retry_delay = 1 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.send_service_user_token = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.split_loggers = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.timeout = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.tls_ciphers = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.tls_min_version = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.verify_ssl = True {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican.verify_ssl_path = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican_service_user.auth_section = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican_service_user.auth_type = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican_service_user.cafile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican_service_user.certfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican_service_user.collect_timing = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican_service_user.insecure = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican_service_user.keyfile = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican_service_user.split_loggers = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican_service_user.timeout = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican_service_user.tls_ciphers = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] barbican_service_user.tls_min_version = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.approle_role_id = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.approle_secret_id = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.auth_method = approle {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.auth_path = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.kv_mountpoint = secret {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.kv_path = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.kv_version = 2 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.namespace = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.root_token_id = **** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.ssl_ca_crt_file = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.timeout = 60.0 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.token_file = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.token_role = None {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.use_ssl = False {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:29:50 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] ******************************************************************************** {{(pid=75584) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 18:29:50 devstack sudo[75751]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:50 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:50 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:50 devstack sudo[75841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:29:50 devstack sudo[75841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:51 devstack sudo[75841]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.281s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:29:51 devstack cinder-volume[75744]: INFO cinder.brick.local_dev.lvm [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 29 18:29:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:51 devstack sudo[75942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:29:51 devstack sudo[75942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:51 devstack sudo[75942]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:51 devstack cinder-volume[75744]: DEBUG cinder.brick.local_dev.lvm [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75744) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 29 18:29:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:51 devstack sudo[76038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:29:51 devstack sudo[76038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:51 devstack sudo[76038]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.492s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:51 devstack sudo[76257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:29:51 devstack sudo[76257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:52 devstack sudo[76257]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:52 devstack sudo[76360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 29 18:29:52 devstack sudo[76360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:52 devstack sudo[76360]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.263s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:52 devstack sudo[76363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:29:52 devstack sudo[76363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:52 devstack sudo[76363]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.333s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:52 devstack sudo[76446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:29:52 devstack sudo[76446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:53 devstack sudo[76446]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:53 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:53 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:53 devstack sudo[76449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:29:53 devstack sudo[76449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:53 devstack sudo[76449]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:53 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:53 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:53 devstack sudo[76538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:29:53 devstack sudo[76538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:53 devstack sudo[76538]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:53 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.287s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:53 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:53 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:53 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:53 devstack sudo[76542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:29:53 devstack sudo[76542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:53 devstack sudo[76542]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:53 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:53 devstack cinder-volume[75744]: INFO cinder.volume.drivers.lvm [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 29 18:29:53 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:53 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:53 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:53 devstack sudo[76552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:29:53 devstack sudo[76552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:54 devstack sudo[76552]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:54 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:54 devstack cinder-volume[75744]: DEBUG cinder.volume.drivers.lvm [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Updating volume stats {{(pid=75744) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:29:54 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:54 devstack sudo[76555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:29:54 devstack sudo[76555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:54 devstack sudo[76555]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:54 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:54 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:54 devstack sudo[76558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:29:54 devstack sudo[76558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:54 devstack sudo[76558]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:54 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:54 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:54 devstack sudo[76561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:29:54 devstack sudo[76561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:55 devstack sudo[76561]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:55 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:55 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:55 devstack sudo[76564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:29:55 devstack sudo[76564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:55 devstack sudo[76564]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:55 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:55 devstack cinder-volume[75744]: INFO cinder.volume.driver [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Driver hasn't implemented _init_vendor_properties() Sep 29 18:29:55 devstack cinder-volume[75744]: DEBUG cinder.volume.driver [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75744) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 18:29:55 devstack cinder-volume[75744]: DEBUG oslo_db.sqlalchemy.engines [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75744) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:29:55 devstack cinder-volume[75744]: DEBUG dbcounter [-] [75744] Writer thread running {{(pid=75744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 18:29:55 devstack cinder-volume[75744]: DEBUG cinder.db.api [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Building query based on filter {{(pid=75744) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 18:29:55 devstack cinder-volume[75744]: DEBUG cinder.image.image_utils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75744) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 18:29:55 devstack cinder-volume[75744]: INFO cinder.keymgr.migration [None req-2e00db69-43f1-41d6-bdf0-85966b02aef6 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 18:29:55 devstack cinder-volume[75744]: DEBUG cinder.volume.drivers.lvm [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Updating volume stats {{(pid=75744) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:29:55 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:55 devstack sudo[76569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:29:55 devstack sudo[76569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:55 devstack sudo[76569]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:55 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:55 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:55 devstack sudo[76572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:29:55 devstack sudo[76572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:56 devstack sudo[76572]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:56 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.311s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:56 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:56 devstack sudo[76575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:29:56 devstack sudo[76575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:56 devstack sudo[76575]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:56 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:56 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:56 devstack sudo[76579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:29:56 devstack sudo[76579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:56 devstack sudo[76579]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:56 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.279s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:56 devstack cinder-volume[75744]: DEBUG cinder.manager [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Notifying Schedulers of capabilities ... {{(pid=75744) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:29:56 devstack cinder-volume[75744]: INFO cinder.volume.manager [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Driver initialization completed successfully. Sep 29 18:29:56 devstack cinder-volume[75744]: INFO cinder.manager [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Initiating service 2 cleanup Sep 29 18:29:56 devstack cinder-volume[75744]: INFO cinder.manager [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Service 2 cleanup completed. Sep 29 18:29:56 devstack cinder-volume[75744]: DEBUG cinder.service [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Creating RPC server for service cinder-volume {{(pid=75744) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 18:29:56 devstack cinder-volume[75744]: DEBUG cinder.service [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75744) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 18:29:56 devstack cinder-volume[75744]: INFO cinder.volume.manager [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 29 18:29:56 devstack cinder-volume[75744]: DEBUG cinder.volume.drivers.lvm [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Updating volume stats {{(pid=75744) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:29:56 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:56 devstack sudo[76582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:29:56 devstack sudo[76582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:57 devstack sudo[76582]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:57 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:57 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:57 devstack sudo[76590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:29:57 devstack sudo[76590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:57 devstack sudo[76590]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:57 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:57 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:57 devstack sudo[76593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:29:57 devstack sudo[76593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:57 devstack sudo[76593]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:57 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:57 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:29:57 devstack sudo[76596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:29:57 devstack sudo[76596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:29:57 devstack sudo[76596]: pam_unix(sudo:session): session closed for user root Sep 29 18:29:57 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:29:57 devstack cinder-volume[75744]: INFO cinder.volume.manager [None req-3022b60d-7147-4dc4-b97e-c0ed3c372176 None None] Driver post RPC initialization completed successfully. Sep 29 18:30:00 devstack cinder-volume[75584]: DEBUG dbcounter [-] [75584] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75584) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:30:06 devstack cinder-volume[75744]: DEBUG dbcounter [-] [75744] Writing DB stats cinder:SELECT=4 {{(pid=75744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:30:07 devstack cinder-volume[75744]: DEBUG dbcounter [-] [75744] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:30:51 devstack cinder-volume[75744]: DEBUG oslo_service.periodic_task [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75744) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:30:51 devstack cinder-volume[75744]: DEBUG cinder.volume.drivers.lvm [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Updating volume stats {{(pid=75744) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:30:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:51 devstack sudo[78510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:30:51 devstack sudo[78510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:52 devstack sudo[78510]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:52 devstack sudo[78513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:30:52 devstack sudo[78513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:52 devstack sudo[78513]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:52 devstack sudo[78517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:30:52 devstack sudo[78517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:52 devstack sudo[78517]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.260s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:30:52 devstack sudo[78520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:30:52 devstack sudo[78520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:30:52 devstack sudo[78520]: pam_unix(sudo:session): session closed for user root Sep 29 18:30:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:30:52 devstack cinder-volume[75744]: DEBUG cinder.manager [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Notifying Schedulers of capabilities ... {{(pid=75744) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:30:52 devstack cinder-volume[75744]: DEBUG oslo_service.periodic_task [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running periodic task VolumeManager._thread_info {{(pid=75744) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:30:52 devstack cinder-volume[75744]: DEBUG cinder.volume.manager [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] thread count: 6 {{(pid=75744) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:30:52 devstack cinder-volume[75744]: DEBUG cinder.volume.manager [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] thread info: [<_MainThread(MainThread, started 135482929586304)>, , , , , ] {{(pid=75744) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:31:51 devstack cinder-volume[75744]: DEBUG oslo_service.periodic_task [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75744) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:31:51 devstack cinder-volume[75744]: DEBUG cinder.volume.drivers.lvm [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Updating volume stats {{(pid=75744) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:31:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:51 devstack sudo[81852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:31:51 devstack sudo[81852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:52 devstack sudo[81852]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.248s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:52 devstack sudo[81855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:31:52 devstack sudo[81855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:52 devstack sudo[81855]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:52 devstack sudo[81876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:31:52 devstack sudo[81876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:52 devstack sudo[81876]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:31:52 devstack sudo[81879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:31:52 devstack sudo[81879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:31:52 devstack sudo[81879]: pam_unix(sudo:session): session closed for user root Sep 29 18:31:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:31:52 devstack cinder-volume[75744]: DEBUG cinder.manager [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Notifying Schedulers of capabilities ... {{(pid=75744) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:32:07 devstack cinder-volume[75744]: DEBUG dbcounter [-] [75744] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:32:51 devstack cinder-volume[75744]: DEBUG oslo_service.periodic_task [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75744) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:32:51 devstack cinder-volume[75744]: DEBUG cinder.volume.drivers.lvm [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Updating volume stats {{(pid=75744) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:32:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:51 devstack sudo[83891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:32:51 devstack sudo[83891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:52 devstack sudo[83891]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:52 devstack sudo[83897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:32:52 devstack sudo[83897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:52 devstack sudo[83897]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:52 devstack sudo[83901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:32:52 devstack sudo[83901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:52 devstack sudo[83901]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.312s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:32:52 devstack sudo[83905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:32:52 devstack sudo[83905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:32:52 devstack sudo[83905]: pam_unix(sudo:session): session closed for user root Sep 29 18:32:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:32:52 devstack cinder-volume[75744]: DEBUG cinder.manager [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Notifying Schedulers of capabilities ... {{(pid=75744) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:32:52 devstack cinder-volume[75744]: DEBUG oslo_service.periodic_task [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running periodic task VolumeManager._thread_info {{(pid=75744) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:32:52 devstack cinder-volume[75744]: DEBUG cinder.volume.manager [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] thread count: 6 {{(pid=75744) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:32:52 devstack cinder-volume[75744]: DEBUG cinder.volume.manager [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] thread info: [<_MainThread(MainThread, started 135482929586304)>, , , , , ] {{(pid=75744) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:33:51 devstack cinder-volume[75744]: DEBUG oslo_service.periodic_task [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75744) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:33:51 devstack cinder-volume[75744]: DEBUG cinder.volume.drivers.lvm [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Updating volume stats {{(pid=75744) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 29 18:33:51 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:51 devstack sudo[85054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 29 18:33:51 devstack sudo[85054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:52 devstack sudo[85054]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.240s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:52 devstack sudo[85067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:33:52 devstack sudo[85067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:52 devstack sudo[85067]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:52 devstack sudo[85080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 29 18:33:52 devstack sudo[85080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:52 devstack sudo[85080]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:33:52 devstack sudo[85102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 29 18:33:52 devstack sudo[85102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:33:52 devstack sudo[85102]: pam_unix(sudo:session): session closed for user root Sep 29 18:33:52 devstack cinder-volume[75744]: DEBUG oslo_concurrency.processutils [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.239s {{(pid=75744) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:33:52 devstack cinder-volume[75744]: DEBUG cinder.manager [None req-3c6d9f81-9f9d-4f86-a7a8-99800b7930c0 None None] Notifying Schedulers of capabilities ... {{(pid=75744) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:34:07 devstack cinder-volume[75744]: DEBUG dbcounter [-] [75744] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75744) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:34:17 devstack cinder-volume[75584]: INFO oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Caught SIGTERM, stopping children Sep 29 18:34:17 devstack cinder-volume[75584]: DEBUG oslo_concurrency.lockutils [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Acquiring lock "singleton_lock" {{(pid=75584) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:34:17 devstack cinder-volume[75584]: DEBUG oslo_concurrency.lockutils [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Acquired lock "singleton_lock" {{(pid=75584) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:34:17 devstack cinder-volume[75584]: DEBUG oslo_concurrency.lockutils [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Releasing lock "singleton_lock" {{(pid=75584) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:34:17 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Stop services. {{(pid=75584) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 29 18:34:17 devstack cinder-volume[75584]: DEBUG oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Killing children. {{(pid=75584) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 29 18:34:17 devstack cinder-volume[75584]: INFO oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Waiting on 1 children to exit Sep 29 18:34:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.lockutils [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Acquiring lock "singleton_lock" {{(pid=75744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:34:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.lockutils [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Acquired lock "singleton_lock" {{(pid=75744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:34:21 devstack cinder-volume[75744]: DEBUG oslo_concurrency.lockutils [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Releasing lock "singleton_lock" {{(pid=75744) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:34:21 devstack cinder-volume[75744]: WARNING amqp [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 18:34:21 devstack cinder-volume[75744]: WARNING amqp [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 18:34:21 devstack cinder-volume[75584]: INFO oslo_service.backend._eventlet.service [None req-99e05334-5ddd-45ad-a2a7-303b22d1a6b0 None None] Child 75744 exited with status 0 Sep 29 18:34:22 devstack cinder-volume[85691]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 18:34:22 devstack cinder-volume[85691]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 18:34:22 devstack cinder-volume[85691]: we strongly recommend against using it for new projects. Sep 29 18:34:22 devstack cinder-volume[85691]: If you are already using Eventlet, we recommend migrating to a different Sep 29 18:34:22 devstack cinder-volume[85691]: framework. For more detail see Sep 29 18:34:22 devstack cinder-volume[85691]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 18:34:22 devstack cinder-volume[85691]: import eventlet # noqa Sep 29 18:34:24 devstack cinder-volume[85691]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:34:24 devstack cinder-volume[85691]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:34:24 devstack cinder-volume[85691]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:34:24 devstack cinder-volume[85691]: INFO dbcounter [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Registered counter for database cinder Sep 29 18:34:24 devstack cinder-volume[85691]: DEBUG oslo_db.sqlalchemy.engines [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85691) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG dbcounter [-] [85691] Writer thread running {{(pid=85691) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 18:34:25 devstack cinder-volume[85691]: INFO cinder.rpc [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 18:34:25 devstack cinder-volume[85691]: INFO cinder.rpc [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_db.sqlalchemy.engines [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85691) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:34:25 devstack cinder-volume[85691]: INFO cinder.volume.manager [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Determined volume DB was empty at startup. Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG cinder.volume.manager [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85691) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Sep 29 18:34:25 devstack cinder-volume[85691]: INFO cinder.volume.manager [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 29 18:34:25 devstack cinder-volume[85691]: WARNING stevedore.named [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 18:34:25 devstack cinder-volume[85691]: WARNING castellan.key_manager [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:34:25 devstack cinder-volume[85691]: WARNING cinder.keymgr.conf_key_mgr [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:34:25 devstack cinder-volume[85691]: INFO cinder.volume.manager [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_db.sqlalchemy.engines [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85691) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:34:25 devstack cinder-volume[85691]: INFO oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Starting 1 workers Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Started child 85907 {{(pid=85691) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Full set of CONF: {{(pid=85691) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] ******************************************************************************** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Configuration options gathered from: {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] ================================================================================ {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] allow_availability_zone_fallback = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] allow_compression_on_image_upload = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] allowed_direct_url_schemes = [] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] api_rate_limit = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] auth_strategy = keystone {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_availability_zone = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_host = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_name = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_stats_polling_interval = 60 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backup_api_class = cinder.backup.api.API {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backup_name_template = backup-%s {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backup_use_same_host = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backup_use_temp_snapshot = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] chap_password = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] chap_username = {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cinder_internal_tenant_project_id = 40ccd4467cfd467390acfcf5c322022f {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cinder_internal_tenant_user_id = a667b24308cb4b04a28e368ff3143453 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cluster = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] compression_format = gzip {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] compute_api_class = cinder.compute.nova.API {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] config_dir = [] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] config_source = [] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] control_exchange = openstack {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] debug = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] default_availability_zone = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] default_group_type = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] default_volume_type = QuobyteHD {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] disk_geometry = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] driver_client_cert = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] driver_client_cert_key = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] driver_data_namespace = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] driver_ssl_cert_path = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] driver_ssl_cert_verify = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85907]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] driver_use_ssl = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] enable_new_services = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] enable_unsupported_driver = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] enabled_backends = ['QuobyteHD'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] enforce_multipath_for_image_xfer = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] filter_function = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance_api_insecure = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance_api_ssl_compression = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance_ca_certificates_file = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance_catalog_info = image:glance:publicURL {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance_certfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance_keyfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance_num_retries = 3 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance_request_timeout = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] goodness_function = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] graceful_shutdown_timeout = 5 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] group_api_class = cinder.group.api.API {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] host = devstack {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] image_compress_on_upload = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] image_conversion_address_space_limit = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] image_conversion_cpu_limit = 60 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] image_conversion_disable = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] image_introspection_address_space_limit = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] image_introspection_cpu_limit = 60 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] image_upload_use_cinder_backend = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] image_upload_use_internal_tenant = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] image_volume_cache_enabled = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] image_volume_cache_max_count = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] image_volume_cache_max_size_gb = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] init_host_max_objects_retrieval = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] instance_format = [instance: %(uuid)s] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] iscsi_target_flags = {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] iscsi_write_cache = on {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] iser_helper = tgtadm {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] iser_ip_address = 192.168.122.213 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] iser_port = 3260 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] log_color = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] log_config_append = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] log_dir = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] log_file = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] log_options = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] log_rotate_interval = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] log_rotate_interval_type = days {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] log_rotation_type = none {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] max_age = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] max_logfile_count = 30 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] max_logfile_size_mb = 200 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] max_over_subscription_ratio = 20.0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] message_reap_interval = 86400 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] message_ttl = 2592000 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] migration_create_volume_timeout_secs = 300 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] monkey_patch = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] monkey_patch_modules = [] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] my_ip = 192.168.122.213 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] no_snapshot_gb_quota = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] num_iser_scan_tries = 3 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] num_shell_tries = 3 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] num_volume_device_scan_tries = 3 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] nvmeof_conn_info_version = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] nvmet_ns_id = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] nvmet_port_id = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] osapi_max_limit = 1000 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] osapi_volume_ext_list = [] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] osapi_volume_listen = 0.0.0.0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] osapi_volume_listen_port = 8776 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] osapi_volume_use_ssl = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] osapi_volume_workers = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] per_volume_size_limit = -1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] periodic_fuzzy_delay = 60 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] periodic_interval = 60 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] project_id_regex = [0-9a-f\-]+ {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] public_endpoint = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] publish_errors = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] quota_backup_gigabytes = 1000 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] quota_backups = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] quota_gigabytes = 1000 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] quota_groups = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] quota_snapshots = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] quota_volumes = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] rate_limit_burst = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] rate_limit_except_level = CRITICAL {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] rate_limit_interval = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] reinit_driver_count = 3 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] replication_device = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] report_discard_supported = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] report_interval = 120 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] reservation_clean_interval = 86400 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] reservation_expire = 86400 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] reserved_image_namespaces = [] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] reserved_percentage = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] rpc_response_timeout = 120 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] run_external_periodic_tasks = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] scst_target_driver = iscsi {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] scst_target_iqn_name = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] service_down_time = 720 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] shell_completion = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] snapshot_name_template = snapshot-%s {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] split_loggers = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] state_path = /opt/stack/data/cinder {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] storage_availability_zone = nova {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] storage_protocol = iSCSI {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] syslog_log_facility = LOG_USER {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] target_helper = lioadm {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] target_ip_address = 192.168.122.213 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] target_port = 3260 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] target_protocol = iscsi {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] target_secondary_ip_addresses = [] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] trace_flags = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] transfer_api_class = cinder.transfer.api.API {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] transport_url = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] until_refresh = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] use_chap_auth = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] use_default_quota_class = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] use_journal = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] use_json = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] use_multipath_for_image_xfer = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] use_stderr = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] use_syslog = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] verify_glance_signatures = enabled {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] volume_api_class = cinder.volume.api.API {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] volume_backend_name = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] volume_clear = zero {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] volume_clear_ionice = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] volume_clear_size = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] volume_copy_bps_limit = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] volume_dd_blocksize = 1M {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] volume_name_template = volume-%s {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] volume_service_inithost_offload = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] volume_usage_audit_period = month {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] zoning_mode = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_concurrency.disable_process_locking = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.auth_section = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.auth_type = password {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.auth_version = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.cache = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.certfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.delay_auth_decision = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.http_connect_timeout = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.include_service_catalog = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.insecure = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.interface = public {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.keyfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_password = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcache_username = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.region_name = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.service_token_roles_required = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.service_type = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.token_cache_time = 300 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.backend = dogpile.cache.null {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.backend_argument = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.backend_expiration_time = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.config_prefix = cache.oslo {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.debug_cache_backend = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.enable_retry_client = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.enable_socket_keepalive = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.enabled = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.expiration_time = 600 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.hashclient_retry_attempts = 2 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.memcache_dead_retry = 300 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.memcache_pool_maxsize = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.memcache_sasl_enabled = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.password = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.proxies = [] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.redis_db = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.redis_sentinel_service_name = mymaster {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.redis_server = localhost:6379 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.retry_attempts = 2 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.retry_delay = 0.0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.socket_keepalive_count = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.socket_keepalive_idle = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.socket_keepalive_interval = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.socket_timeout = 1.0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.tls_allowed_ciphers = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.tls_cafile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.tls_certfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.tls_enabled = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.tls_keyfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cache.username = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] coordination.backend_url = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.asyncio_connection = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.asyncio_slave_connection = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.backend = sqlalchemy {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.connection = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.connection_debug = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.connection_parameters = {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.connection_recycle_time = 3600 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.connection_trace = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.db_inc_retry_interval = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.db_max_retries = 20 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.db_max_retry_interval = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.db_retry_interval = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.max_overflow = 50 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.max_pool_size = 5 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.max_retries = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.mysql_wsrep_sync_wait = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.pool_timeout = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.retry_interval = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.slave_connection = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.sqlite_synchronous = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.synchronous_reader = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] database.use_db_reconnect = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_tracing.insecure = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85907]: INFO cinder.volume.manager [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler.connection_string = messaging:// {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler.enabled = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler.es_doc_type = notification {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85907]: DEBUG cinder.volume.drivers.remotefs [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85907) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler.es_scroll_size = 10000 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler.es_scroll_time = 2m {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler.filter_error_trace = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler.hmac_keys = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler.sentinel_service_name = mymaster {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler.socket_timeout = 0.1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler.trace_requests = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler.trace_sqlalchemy = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler_jaeger.process_tags = {} {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler_jaeger.service_name_prefix = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] profiler_otlp.service_name_prefix = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_policy.enforce_new_defaults = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_policy.policy_default_rule = default {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_policy.policy_file = policy.yaml {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_policy.remote_timeout = 60.0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] privsep_osbrick.group = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] privsep_osbrick.helper_command = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] privsep_osbrick.user = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cinder_sys_admin.group = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cinder_sys_admin.helper_command = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] cinder_sys_admin.user = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] service_user.auth_section = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] service_user.auth_type = password {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] service_user.cafile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] service_user.certfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] service_user.collect_timing = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] service_user.insecure = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] service_user.keyfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] service_user.send_service_user_token = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] service_user.split_loggers = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] service_user.timeout = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] service_user.tls_ciphers = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] service_user.tls_min_version = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance.auth_section = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance.auth_type = password {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance.certfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance.collect_timing = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance.insecure = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance.keyfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance.region_name = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance.split_loggers = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance.timeout = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance.tls_ciphers = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] glance.tls_min_version = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.backend_availability_zone = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.chap_password = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.chap_username = {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.disk_geometry = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.driver_client_cert = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.driver_client_cert_key = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.driver_data_namespace = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.driver_use_ssl = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.enable_unsupported_driver = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.extra_capabilities = {} {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.filter_function = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.goodness_function = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.iscsi_target_flags = {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.iscsi_write_cache = on {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.iser_helper = tgtadm {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.iser_port = 3260 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.nas_host = {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.nas_login = admin {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.nas_mount_options = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.nas_password = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.nas_private_key = {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.nas_share_path = {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.nas_ssh_port = 22 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.num_shell_tries = 3 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.nvmet_port_id = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.quobyte_client_cfg = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.quobyte_volume_url = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.replication_device = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.report_discard_supported = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.reserved_percentage = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.scst_target_driver = iscsi {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.scst_target_iqn_name = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.storage_protocol = iSCSI {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.target_helper = tgtadm {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.target_port = 3260 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.target_protocol = iscsi {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.trace_flags = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.unique_fqdn_network = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.use_chap_auth = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.volume_backend_name = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.volume_clear = zero {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.volume_clear_ionice = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.volume_clear_size = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_reports.file_event_handler = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_reports.log_dir = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.backend_availability_zone = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.backend_host = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.chap_password = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.chap_username = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.chiscsi_conf = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.disk_geometry = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.driver_client_cert = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.driver_client_cert_key = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.driver_data_namespace = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.driver_use_ssl = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.extra_capabilities = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.filter_function = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.goodness_function = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.iscsi_target_flags = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.iscsi_write_cache = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.iser_helper = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.iser_ip_address = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.iser_port = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.iser_target_prefix = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.nas_host = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.nas_login = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.nas_mount_options = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.nas_password = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.nas_private_key = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.nas_share_path = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.nas_ssh_port = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.num_shell_tries = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.nvmet_ns_id = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.nvmet_port_id = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.replication_device = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.report_discard_supported = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.reserved_percentage = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.scst_target_driver = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.storage_protocol = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.target_helper = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.target_ip_address = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.target_port = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.target_prefix = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.target_protocol = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.trace_flags = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.unique_fqdn_network = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.use_chap_auth = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.volume_clear = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.volume_clear_ionice = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.volume_clear_size = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] QuobyteHD.volumes_dir = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.ssl = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.ssl_version = {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_notifications.driver = [] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_notifications.retry = -1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] oslo_messaging_notifications.transport_url = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] key_manager.fixed_key = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.barbican_api_version = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.barbican_endpoint = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.barbican_endpoint_type = public {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.barbican_region_name = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.cafile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.certfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.collect_timing = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.insecure = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.keyfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.number_of_retries = 60 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.retry_delay = 1 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.send_service_user_token = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.split_loggers = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.timeout = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.tls_ciphers = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.tls_min_version = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.verify_ssl = True {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican.verify_ssl_path = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican_service_user.auth_section = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican_service_user.auth_type = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican_service_user.cafile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican_service_user.certfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican_service_user.collect_timing = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican_service_user.insecure = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican_service_user.keyfile = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican_service_user.split_loggers = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican_service_user.timeout = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican_service_user.tls_ciphers = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] barbican_service_user.tls_min_version = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.approle_role_id = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.approle_secret_id = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.auth_method = approle {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.auth_path = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.kv_mountpoint = secret {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.kv_path = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.kv_version = 2 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.namespace = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.root_token_id = **** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.ssl_ca_crt_file = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.timeout = 60.0 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.token_file = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.token_role = None {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.use_ssl = False {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:25 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] ******************************************************************************** {{(pid=85691) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 18:34:25 devstack cinder-volume[85907]: DEBUG cinder.volume.drivers.quobyte [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85907) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 29 18:34:25 devstack cinder-volume[85907]: WARNING cinder.volume.drivers.quobyte [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 29 18:34:25 devstack cinder-volume[85907]: WARNING cinder.volume.drivers.quobyte [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 29 18:34:25 devstack cinder-volume[85907]: DEBUG oslo_concurrency.processutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Running cmd (subprocess): mount.quobyte {{(pid=85907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:25 devstack quobyte-client[85912]: Reading configuration file: /etc/quobyte/client.cfg Sep 29 18:34:25 devstack quobyte-client[85912]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 29 18:34:25 devstack cinder-volume[85907]: DEBUG oslo_concurrency.processutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] CMD "mount.quobyte" returned: 1 in 0.085s {{(pid=85907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:25 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:25 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:25 devstack cinder-volume[85907]: DEBUG cinder.volume.drivers.quobyte [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=85907) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:25 devstack cinder-volume[85907]: INFO cinder.volume.drivers.quobyte [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da ... Sep 29 18:34:25 devstack cinder-volume[85907]: DEBUG oslo_concurrency.processutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 -c /etc/quobyte/client-cinder.cfg {{(pid=85907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:25 devstack sudo[85913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 -c /etc/quobyte/client-cinder.cfg Sep 29 18:34:25 devstack sudo[85913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:26 devstack sudo[85913]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG oslo_concurrency.processutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.442s {{(pid=85907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:26 devstack cinder-volume[85907]: INFO cinder.volume.drivers.quobyte [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da succeeded Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG cinder.volume.drivers.quobyte [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=85907) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.452s {{(pid=85907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG oslo_concurrency.processutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=85907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:26 devstack sudo[86015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:34:26 devstack sudo[86015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:26 devstack sudo[86015]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG oslo_concurrency.processutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.261s {{(pid=85907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:26 devstack cinder-volume[85907]: INFO cinder.volume.driver [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Driver hasn't implemented _init_vendor_properties() Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG cinder.volume.driver [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9084281921387, 'free_capacity_gb': 1774.9084281921387, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85907) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG oslo_db.sqlalchemy.engines [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85907) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG dbcounter [-] [85907] Writer thread running {{(pid=85907) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG cinder.db.api [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Building query based on filter {{(pid=85907) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG cinder.image.image_utils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85907) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 18:34:26 devstack cinder-volume[85907]: INFO cinder.keymgr.migration [None req-dc15419c-7440-4da4-b74e-0860c39c4f93 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG cinder.volume.drivers.quobyte [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=85907) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG cinder.volume.drivers.quobyte [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=85907) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:26 devstack cinder-volume[85907]: DEBUG oslo_concurrency.processutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=85907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:26 devstack sudo[86024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:34:26 devstack sudo[86024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:27 devstack sudo[86024]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:27 devstack cinder-volume[85907]: DEBUG oslo_concurrency.processutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.268s {{(pid=85907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:27 devstack cinder-volume[85907]: DEBUG cinder.manager [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Notifying Schedulers of capabilities ... {{(pid=85907) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:34:27 devstack cinder-volume[85907]: INFO cinder.volume.manager [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Driver initialization completed successfully. Sep 29 18:34:27 devstack cinder-volume[85907]: INFO cinder.manager [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Initiating service 3 cleanup Sep 29 18:34:27 devstack cinder-volume[85907]: INFO cinder.manager [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Service 3 cleanup completed. Sep 29 18:34:27 devstack cinder-volume[85907]: DEBUG cinder.service [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Creating RPC server for service cinder-volume {{(pid=85907) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 18:34:27 devstack cinder-volume[85907]: DEBUG cinder.service [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85907) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 18:34:27 devstack cinder-volume[85907]: INFO cinder.volume.manager [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 29 18:34:27 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:27 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:27 devstack cinder-volume[85907]: DEBUG cinder.volume.drivers.quobyte [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=85907) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:27 devstack cinder-volume[85907]: DEBUG cinder.volume.drivers.quobyte [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=85907) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:27 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=85907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:27 devstack cinder-volume[85907]: DEBUG oslo_concurrency.processutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=85907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:27 devstack sudo[86047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:34:27 devstack sudo[86047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:27 devstack sudo[86047]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:27 devstack cinder-volume[85907]: DEBUG oslo_concurrency.processutils [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.280s {{(pid=85907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:27 devstack cinder-volume[85907]: INFO cinder.volume.manager [None req-f7b630a2-6b25-4db5-a0d7-012c7aa69276 None None] Driver post RPC initialization completed successfully. Sep 29 18:34:31 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-fc0adfd2-9734-4147-a0ac-1305621b70b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:31 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-fc0adfd2-9734-4147-a0ac-1305621b70b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:31 devstack cinder-volume[85907]: DEBUG cinder.volume.drivers.quobyte [None req-fc0adfd2-9734-4147-a0ac-1305621b70b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=85907) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:31 devstack cinder-volume[85907]: DEBUG cinder.volume.drivers.quobyte [None req-fc0adfd2-9734-4147-a0ac-1305621b70b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=85907) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:31 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-fc0adfd2-9734-4147-a0ac-1305621b70b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=85907) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:31 devstack cinder-volume[85907]: DEBUG oslo_concurrency.processutils [None req-fc0adfd2-9734-4147-a0ac-1305621b70b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=85907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:31 devstack sudo[86142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:34:31 devstack sudo[86142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:31 devstack sudo[86142]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:31 devstack cinder-volume[85907]: DEBUG oslo_concurrency.processutils [None req-fc0adfd2-9734-4147-a0ac-1305621b70b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.230s {{(pid=85907) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:31 devstack cinder-volume[85907]: DEBUG cinder.manager [None req-fc0adfd2-9734-4147-a0ac-1305621b70b7 None None] Notifying Schedulers of capabilities ... {{(pid=85907) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:34:32 devstack cinder-volume[85691]: INFO oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Caught SIGTERM, stopping children Sep 29 18:34:32 devstack cinder-volume[85691]: DEBUG oslo_concurrency.lockutils [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Acquiring lock "singleton_lock" {{(pid=85691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:34:32 devstack cinder-volume[85691]: DEBUG oslo_concurrency.lockutils [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Acquired lock "singleton_lock" {{(pid=85691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:34:32 devstack cinder-volume[85691]: DEBUG oslo_concurrency.lockutils [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Releasing lock "singleton_lock" {{(pid=85691) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:34:32 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Stop services. {{(pid=85691) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 29 18:34:32 devstack cinder-volume[85691]: DEBUG oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Killing children. {{(pid=85691) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 29 18:34:32 devstack cinder-volume[85691]: INFO oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Waiting on 1 children to exit Sep 29 18:34:35 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Acquiring lock "singleton_lock" {{(pid=85907) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:34:35 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Acquired lock "singleton_lock" {{(pid=85907) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:34:35 devstack cinder-volume[85907]: DEBUG oslo_concurrency.lockutils [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Releasing lock "singleton_lock" {{(pid=85907) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:34:35 devstack cinder-volume[85907]: WARNING amqp [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 18:34:35 devstack cinder-volume[85907]: WARNING amqp [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 29 18:34:35 devstack cinder-volume[85691]: INFO oslo_service.backend._eventlet.service [None req-b96d65da-1d52-45c2-b467-7a0be461aa7a None None] Child 85907 exited with status 0 Sep 29 18:34:36 devstack cinder-volume[86223]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 29 18:34:36 devstack cinder-volume[86223]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 18:34:36 devstack cinder-volume[86223]: we strongly recommend against using it for new projects. Sep 29 18:34:36 devstack cinder-volume[86223]: If you are already using Eventlet, we recommend migrating to a different Sep 29 18:34:36 devstack cinder-volume[86223]: framework. For more detail see Sep 29 18:34:36 devstack cinder-volume[86223]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 18:34:36 devstack cinder-volume[86223]: import eventlet # noqa Sep 29 18:34:39 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 29 18:34:39 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 29 18:34:39 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 29 18:34:39 devstack cinder-volume[86223]: INFO dbcounter [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] Registered counter for database cinder Sep 29 18:34:39 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG dbcounter [-] [86223] Writer thread running {{(pid=86223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 18:34:40 devstack cinder-volume[86223]: INFO cinder.rpc [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 29 18:34:40 devstack cinder-volume[86223]: INFO cinder.rpc [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:34:40 devstack cinder-volume[86223]: INFO cinder.volume.manager [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] Determined volume DB was empty at startup. Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG cinder.volume.manager [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86223) __init__ /opt/stack/cinder/cinder/volume/manager.py:290}} Sep 29 18:34:40 devstack cinder-volume[86223]: WARNING stevedore.named [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 29 18:34:40 devstack cinder-volume[86223]: WARNING castellan.key_manager [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:34:40 devstack cinder-volume[86223]: WARNING cinder.keymgr.conf_key_mgr [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 29 18:34:40 devstack cinder-volume[86223]: INFO cinder.volume.manager [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:34:40 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] Starting 1 workers Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] Started child 86523 {{(pid=86223) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] Full set of CONF: {{(pid=86223) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] ******************************************************************************** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] Configuration options gathered from: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] ================================================================================ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] allow_availability_zone_fallback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] allow_compression_on_image_upload = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86523]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] allowed_direct_url_schemes = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] api_rate_limit = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] auth_strategy = keystone {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_stats_polling_interval = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backup_api_class = cinder.backup.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backup_name_template = backup-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backup_use_same_host = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backup_use_temp_snapshot = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] chap_username = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cinder_internal_tenant_project_id = 40ccd4467cfd467390acfcf5c322022f {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cinder_internal_tenant_user_id = a667b24308cb4b04a28e368ff3143453 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cluster = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] compression_format = gzip {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] compute_api_class = cinder.compute.nova.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] config_dir = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] config_source = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] control_exchange = openstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] debug = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] default_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] default_group_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] default_volume_type = QuobyteHD {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] driver_ssl_cert_verify = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] driver_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] enable_new_services = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] enable_unsupported_driver = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] enabled_backends = ['QuobyteHD'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] enforce_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance_api_insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance_api_servers = ['http://192.168.122.213/image'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance_api_ssl_compression = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance_ca_certificates_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance_catalog_info = image:glance:publicURL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance_num_retries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance_request_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] graceful_shutdown_timeout = 5 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] group_api_class = cinder.group.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] host = devstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] image_compress_on_upload = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] image_conversion_address_space_limit = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] image_conversion_cpu_limit = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] image_conversion_disable = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] image_introspection_address_space_limit = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] image_introspection_cpu_limit = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] image_upload_use_cinder_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] image_upload_use_internal_tenant = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] image_volume_cache_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] image_volume_cache_max_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] image_volume_cache_max_size_gb = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] init_host_max_objects_retrieval = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] instance_format = [instance: %(uuid)s] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] iscsi_target_flags = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] iscsi_write_cache = on {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] iser_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] iser_ip_address = 192.168.122.213 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] iser_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] log_color = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] log_config_append = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] log_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] log_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] log_options = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] log_rotate_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] log_rotate_interval_type = days {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] log_rotation_type = none {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] max_age = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] max_logfile_count = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] max_logfile_size_mb = 200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] max_over_subscription_ratio = 20.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] message_reap_interval = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Starting volume driver QuobyteDriver (1.2.1) Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] message_ttl = 2592000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86523) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] migration_create_volume_timeout_secs = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] monkey_patch = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] monkey_patch_modules = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] my_ip = 192.168.122.213 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] no_snapshot_gb_quota = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] num_iser_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] num_shell_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] num_volume_device_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] nvmeof_conn_info_version = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] nvmet_ns_id = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] nvmet_port_id = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] osapi_max_limit = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] osapi_volume_ext_list = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] osapi_volume_listen = 0.0.0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] osapi_volume_listen_port = 8776 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] osapi_volume_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] osapi_volume_workers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] per_volume_size_limit = -1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] periodic_fuzzy_delay = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] periodic_interval = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] project_id_regex = [0-9a-f\-]+ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] public_endpoint = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] publish_errors = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] quota_backup_gigabytes = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] quota_backups = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] quota_gigabytes = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] quota_groups = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] quota_snapshots = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] quota_volumes = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] rate_limit_burst = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] rate_limit_except_level = CRITICAL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] rate_limit_interval = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] reinit_driver_count = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] report_discard_supported = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] report_interval = 120 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] reservation_clean_interval = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] reservation_expire = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] reserved_image_namespaces = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] reserved_percentage = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] rpc_response_timeout = 120 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] run_external_periodic_tasks = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] scst_target_driver = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] service_down_time = 720 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] shell_completion = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] snapshot_name_template = snapshot-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] state_path = /opt/stack/data/cinder {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] storage_availability_zone = nova {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] storage_protocol = iSCSI {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] syslog_log_facility = LOG_USER {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] target_helper = lioadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] target_ip_address = 192.168.122.213 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] target_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] target_protocol = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] target_secondary_ip_addresses = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] transfer_api_class = cinder.transfer.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] transport_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] until_refresh = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] use_chap_auth = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] use_default_quota_class = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] use_journal = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] use_json = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] use_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] use_stderr = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] use_syslog = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] verify_glance_signatures = enabled {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] volume_api_class = cinder.volume.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] volume_backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] volume_clear = zero {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] volume_clear_size = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] volume_copy_bps_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] volume_dd_blocksize = 1M {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] volume_name_template = volume-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] volume_service_inithost_offload = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] volume_usage_audit_period = month {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] zoning_mode = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_concurrency.disable_process_locking = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.auth_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.delay_auth_decision = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.http_connect_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.include_service_catalog = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.interface = public {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcache_username = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.service_token_roles_required = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.service_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.token_cache_time = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86523) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.213/identity {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.quobyte [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 29 18:34:40 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.quobyte [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Running cmd (subprocess): mount.quobyte {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.backend = dogpile.cache.null {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.backend_argument = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.backend_expiration_time = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.config_prefix = cache.oslo {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.debug_cache_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.enable_retry_client = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.enable_socket_keepalive = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.expiration_time = 600 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.hashclient_retry_attempts = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.memcache_dead_retry = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.memcache_pool_maxsize = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.memcache_sasl_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.proxies = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.redis_db = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.redis_sentinel_service_name = mymaster {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.redis_server = localhost:6379 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.retry_attempts = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.retry_delay = 0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.socket_keepalive_count = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.socket_keepalive_idle = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.socket_keepalive_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.socket_timeout = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.tls_allowed_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.tls_cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.tls_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.tls_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.tls_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cache.username = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] coordination.backend_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.asyncio_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.asyncio_slave_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.backend = sqlalchemy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.connection_debug = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.connection_parameters = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.connection_recycle_time = 3600 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.connection_trace = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.db_inc_retry_interval = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.db_max_retries = 20 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.db_max_retry_interval = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.db_retry_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.max_overflow = 50 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.max_pool_size = 5 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.max_retries = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.mysql_wsrep_sync_wait = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.pool_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.retry_interval = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.slave_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.sqlite_synchronous = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.synchronous_reader = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] database.use_db_reconnect = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_tracing.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler.connection_string = messaging:// {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler.enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler.es_doc_type = notification {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler.es_scroll_size = 10000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler.es_scroll_time = 2m {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler.filter_error_trace = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler.hmac_keys = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler.sentinel_service_name = mymaster {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler.socket_timeout = 0.1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler.trace_requests = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler.trace_sqlalchemy = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler_jaeger.process_tags = {} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler_jaeger.service_name_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] profiler_otlp.service_name_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_policy.enforce_new_defaults = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_policy.policy_default_rule = default {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_policy.policy_file = policy.yaml {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_policy.remote_timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] privsep_osbrick.group = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] privsep_osbrick.helper_command = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] privsep_osbrick.user = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cinder_sys_admin.group = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cinder_sys_admin.helper_command = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] cinder_sys_admin.user = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] service_user.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] service_user.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] service_user.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] service_user.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] service_user.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] service_user.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] service_user.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] service_user.send_service_user_token = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] service_user.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] service_user.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] service_user.tls_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] service_user.tls_min_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] CMD "mount.quobyte" returned: 1 in 0.057s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance.region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance.tls_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] glance.tls_min_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.chap_username = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.driver_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.enable_unsupported_driver = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.extra_capabilities = {} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.iscsi_target_flags = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.iscsi_write_cache = on {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.iser_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.iser_ip_address = 192.168.122.213 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.iser_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.nas_host = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.nas_login = admin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.nas_mount_options = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.nas_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.nas_private_key = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.nas_share_path = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.nas_ssh_port = 22 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.num_shell_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.nvmet_port_id = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.quobyte_client_cfg = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.quobyte_volume_url = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.report_discard_supported = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.reserved_percentage = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.scst_target_driver = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.storage_protocol = iSCSI {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.target_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.target_ip_address = 192.168.122.213 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.target_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.target_protocol = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.unique_fqdn_network = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.use_chap_auth = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.volume_backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.volume_clear = zero {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.volume_clear_size = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_reports.file_event_handler = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_reports.log_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.backend_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.chap_username = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.chiscsi_conf = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.driver_use_ssl = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.extra_capabilities = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.iscsi_target_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.iscsi_write_cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.iser_helper = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.iser_ip_address = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.iser_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.iser_target_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.nas_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.nas_login = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.nas_mount_options = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.nas_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.nas_private_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.nas_share_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.nas_ssh_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.num_shell_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.nvmet_ns_id = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.nvmet_port_id = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.report_discard_supported = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.reserved_percentage = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.scst_target_driver = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.storage_protocol = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.target_helper = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.target_ip_address = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.target_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.target_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.target_protocol = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.unique_fqdn_network = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.use_chap_auth = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.volume_clear = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.volume_clear_size = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] QuobyteHD.volumes_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.ssl_version = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_notifications.driver = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_notifications.retry = -1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] oslo_messaging_notifications.transport_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] key_manager.fixed_key = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.barbican_api_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.barbican_endpoint = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.barbican_endpoint_type = public {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.barbican_region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.number_of_retries = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.retry_delay = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.send_service_user_token = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.tls_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.tls_min_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.verify_ssl = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican.verify_ssl_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican_service_user.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican_service_user.auth_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican_service_user.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican_service_user.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican_service_user.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican_service_user.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican_service_user.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican_service_user.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican_service_user.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican_service_user.tls_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] barbican_service_user.tls_min_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.approle_role_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.approle_secret_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.auth_method = approle {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.auth_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.kv_mountpoint = secret {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.kv_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.kv_version = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.root_token_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.ssl_ca_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.token_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.token_role = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 29 18:34:40 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-9b2118e2-2b8a-4882-9fcb-3ddf5d363dda None None] ******************************************************************************** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 29 18:34:40 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.285s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:40 devstack cinder-volume[86523]: INFO cinder.volume.driver [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Driver hasn't implemented _init_vendor_properties() Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG cinder.volume.driver [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9084281921387, 'free_capacity_gb': 1774.9084281921387, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86523) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG oslo_db.sqlalchemy.engines [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86523) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writer thread running {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG cinder.db.api [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Building query based on filter {{(pid=86523) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86523) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:40 devstack cinder-volume[86523]: INFO cinder.keymgr.migration [None req-2b1a3fc1-5306-4a11-9a64-41c6961f4263 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 29 18:34:40 devstack sudo[86545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:34:40 devstack sudo[86545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:41 devstack sudo[86545]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.221s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:41 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:34:41 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Driver initialization completed successfully. Sep 29 18:34:41 devstack cinder-volume[86523]: INFO cinder.manager [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Initiating service 3 cleanup Sep 29 18:34:41 devstack cinder-volume[86523]: INFO cinder.manager [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Service 3 cleanup completed. Sep 29 18:34:41 devstack cinder-volume[86523]: DEBUG cinder.service [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Creating RPC server for service cinder-volume {{(pid=86523) start /opt/stack/cinder/cinder/service.py:231}} Sep 29 18:34:41 devstack cinder-volume[86523]: DEBUG cinder.service [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86523) start /opt/stack/cinder/cinder/service.py:237}} Sep 29 18:34:41 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 29 18:34:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:34:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:34:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:34:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:34:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:34:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:34:41 devstack sudo[86556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:34:41 devstack sudo[86556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:34:41 devstack sudo[86556]: pam_unix(sudo:session): session closed for user root Sep 29 18:34:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.239s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:34:41 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4ba33cec-bcca-4932-b2a1-dbc18775b5cd None None] Driver post RPC initialization completed successfully. Sep 29 18:34:50 devstack cinder-volume[86223]: DEBUG dbcounter [-] [86223] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:34:51 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=2 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:34:51 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:34:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:34:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 6 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:34:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:35:39 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:35:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Flow 'volume_create_manager' (a9370bd9-6b83-4db3-a718-4d86bd1ca27b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:35:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2458fe33-b43d-43a9-8a26-cb13339d7954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2458fe33-b43d-43a9-8a26-cb13339d7954) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-503840487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3737ea19-1cb3-4d35-bdf8-08514ba8adbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a171fbbfabb74c7384690acda840cb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:40Z,use_quota=True,user_id='5a254aa6a11d4f35ad447fa1557cbb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d02b57-05f6-41ec-b5ac-67002976ba90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5d02b57-05f6-41ec-b5ac-67002976ba90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cbecd32-6758-4008-86f8-3ecbd5693312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cbecd32-6758-4008-86f8-3ecbd5693312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3737ea19-1cb3-4d35-bdf8-08514ba8adbf', 'volume_name': 'volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03e4e05-3d09-46e8-9dd0-a9425152d291) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e03e4e05-3d09-46e8-9dd0-a9425152d291) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50ed005-42b2-4db2-b152-96e50c89b35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:40 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Volume 3737ea19-1cb3-4d35-bdf8-08514ba8adbf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf', 'volume_size': 1} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:35:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-503840487',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3737ea19-1cb3-4d35-bdf8-08514ba8adbf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a171fbbfabb74c7384690acda840cb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:40Z,use_quota=True,user_id='5a254aa6a11d4f35ad447fa1557cbb53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Creating volume 3737ea19-1cb3-4d35-bdf8-08514ba8adbf {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.054s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:35:40 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:35:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:35:40 devstack sudo[87170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf 1073741824 Sep 29 18:35:40 devstack sudo[87170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:35:41 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:35:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Flow 'volume_create_manager' (5a755865-90ae-40d1-8f6d-fbb034e1c45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:35:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81c8894-8faf-44e6-b2af-a55a1d0a37eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d81c8894-8faf-44e6-b2af-a55a1d0a37eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1003565566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff4f40e-c7df-4cfd-a4fc-ae779f443012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='931ef82bb3a648128e89376e080e5bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:41Z,use_quota=True,user_id='8445dc2ace4f4a90a1fdcc946cd7f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457e8645-0529-4746-85f1-d8e69f695d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (457e8645-0529-4746-85f1-d8e69f695d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cb400d-b5e3-412d-a8c5-bf8d12a73897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3cb400d-b5e3-412d-a8c5-bf8d12a73897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ff4f40e-c7df-4cfd-a4fc-ae779f443012', 'volume_name': 'volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9d730d-8d2a-497a-8e70-6fefe580df2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9d730d-8d2a-497a-8e70-6fefe580df2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b8397c-7aab-4bf9-a21f-78088af34637) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:41 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Volume 1ff4f40e-c7df-4cfd-a4fc-ae779f443012: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012', 'volume_size': 1} Sep 29 18:35:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:35:42 devstack sudo[87170]: pam_unix(sudo:session): session closed for user root Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf 1073741824" returned: 0 in 1.720s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:35:42 devstack sudo[87593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf Sep 29 18:35:42 devstack sudo[87593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:35:42 devstack sudo[87593]: pam_unix(sudo:session): session closed for user root Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf" returned: 0 in 0.473s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] <== create_volume: return (2393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.405s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.299s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:35:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1003565566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ff4f40e-c7df-4cfd-a4fc-ae779f443012,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='931ef82bb3a648128e89376e080e5bff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:35:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:35:41Z,use_quota=True,user_id='8445dc2ace4f4a90a1fdcc946cd7f638',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Creating volume 1ff4f40e-c7df-4cfd-a4fc-ae779f443012 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:35:42 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:35:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:35:42 devstack sudo[87604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012 1073741824 Sep 29 18:35:42 devstack sudo[87604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:35:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a50ed005-42b2-4db2-b152-96e50c89b35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bafd0d-5474-4bfe-a46e-4155d52f762b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:43 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Volume volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf (3737ea19-1cb3-4d35-bdf8-08514ba8adbf): created successfully Sep 29 18:35:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68bafd0d-5474-4bfe-a46e-4155d52f762b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Flow 'volume_create_manager' (a9370bd9-6b83-4db3-a718-4d86bd1ca27b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:35:43 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-b3871ff3-7566-4e80-89ab-b5627f61ac1c tempest-TaggedAttachmentsTest-128244948 None] Created volume successfully. Sep 29 18:35:44 devstack sudo[87604]: pam_unix(sudo:session): session closed for user root Sep 29 18:35:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012 1073741824" returned: 0 in 1.394s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:35:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:35:44 devstack sudo[87631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012 Sep 29 18:35:44 devstack sudo[87631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:35:44 devstack sudo[87631]: pam_unix(sudo:session): session closed for user root Sep 29 18:35:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012" returned: 0 in 0.407s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:35:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] <== create_volume: return (1902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:35:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.912s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:35:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43b8397c-7aab-4bf9-a21f-78088af34637) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6128bf-0580-4701-8e7f-c079b547dcf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:35:44 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Volume volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012 (1ff4f40e-c7df-4cfd-a4fc-ae779f443012): created successfully Sep 29 18:35:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e6128bf-0580-4701-8e7f-c079b547dcf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:35:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Flow 'volume_create_manager' (5a755865-90ae-40d1-8f6d-fbb034e1c45c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:35:44 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e8bf94a6-1081-4878-bfc0-49b06853b9b8 tempest-DeleteServersTestJSON-1149970903 None] Created volume successfully. Sep 29 18:35:50 devstack cinder-volume[86523]: WARNING py.warnings [req-b0b4278b-399a-407d-855d-187e9b17d45d req-9031be1e-e3eb-4ef8-97cc-7c9dd9dff88d tempest-DeleteServersTestJSON-1149970903 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 29 18:35:50 devstack cinder-volume[86523]: .first() Sep 29 18:35:50 devstack cinder-volume[86523]: Sep 29 18:35:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-b0b4278b-399a-407d-855d-187e9b17d45d req-9031be1e-e3eb-4ef8-97cc-7c9dd9dff88d tempest-DeleteServersTestJSON-1149970903 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:35:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-b0b4278b-399a-407d-855d-187e9b17d45d req-9031be1e-e3eb-4ef8-97cc-7c9dd9dff88d tempest-DeleteServersTestJSON-1149970903 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:35:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-b0b4278b-399a-407d-855d-187e9b17d45d req-9031be1e-e3eb-4ef8-97cc-7c9dd9dff88d tempest-DeleteServersTestJSON-1149970903 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:35:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-b0b4278b-399a-407d-855d-187e9b17d45d req-9031be1e-e3eb-4ef8-97cc-7c9dd9dff88d tempest-DeleteServersTestJSON-1149970903 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8d8b77b9-1f00-40f1-8946-ddbb59b47913', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:35:51 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-b0b4278b-399a-407d-855d-187e9b17d45d req-9031be1e-e3eb-4ef8-97cc-7c9dd9dff88d tempest-DeleteServersTestJSON-1149970903 None] attachment_update completed successfully. Sep 29 18:35:58 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-7c82ca65-46cf-456a-aa8f-ade498ef29a7 req-4a1e5e02-5b98-45b4-b578-5401f9c03424 tempest-DeleteServersTestJSON-1149970903 None] Terminate volume connection completed successfully. Sep 29 18:35:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-7c82ca65-46cf-456a-aa8f-ade498ef29a7 req-4a1e5e02-5b98-45b4-b578-5401f9c03424 tempest-DeleteServersTestJSON-1149970903 None] Deleting attachment 8d8b77b9-1f00-40f1-8946-ddbb59b47913. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:35:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:35:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:35:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:35:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:35:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:35:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:35:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:35:58 devstack sudo[88238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:35:58 devstack sudo[88238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:35:59 devstack sudo[88238]: pam_unix(sudo:session): session closed for user root Sep 29 18:35:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.500s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:35:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:35:59 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:35:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 6 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:35:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:35:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Acquiring lock "cinder-1ff4f40e-c7df-4cfd-a4fc-ae779f443012-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:35:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Lock "cinder-1ff4f40e-c7df-4cfd-a4fc-ae779f443012-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:35:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Acquiring lock "cinder-quobyte-1ff4f40e-c7df-4cfd-a4fc-ae779f443012" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Lock "cinder-quobyte-1ff4f40e-c7df-4cfd-a4fc-ae779f443012" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:00 devstack cinder-volume[86523]: INFO oslo.privsep.daemon [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp964rb8fo/privsep.sock'] Sep 29 18:36:00 devstack sudo[88251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp964rb8fo/privsep.sock Sep 29 18:36:00 devstack sudo[88251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:01 devstack cinder-volume[86523]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 29 18:36:01 devstack cinder-volume[86523]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 29 18:36:01 devstack cinder-volume[86523]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 29 18:36:01 devstack cinder-volume[86523]: WARNING oslo.privsep.daemon [-] privsep log: Sep 29 18:36:01 devstack cinder-volume[86523]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 29 18:36:01 devstack cinder-volume[86523]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 29 18:36:01 devstack cinder-volume[86523]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 29 18:36:01 devstack cinder-volume[86523]: WARNING oslo.privsep.daemon [-] privsep log: Sep 29 18:36:01 devstack cinder-volume[86523]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 29 18:36:01 devstack sudo[88251]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:01 devstack cinder-volume[86523]: INFO oslo.privsep.daemon [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Spawned new privsep daemon via rootwrap Sep 29 18:36:01 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Accepted privsep connection to /tmp/tmp964rb8fo/privsep.sock {{(pid=86523) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 29 18:36:01 devstack cinder-volume[86523]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 29 18:36:01 devstack cinder-volume[86523]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 29 18:36:01 devstack cinder-volume[86523]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 29 18:36:01 devstack cinder-volume[86523]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88302 Sep 29 18:36:01 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19597f4-d65f-4be0-a62d-a5ccd2eb71e3]: (2,) {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:01 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c773eb0e-858d-4ba5-b1ff-ca600106356f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:01 devstack sudo[88305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012 Sep 29 18:36:01 devstack sudo[88305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:02 devstack sudo[88305]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012" returned: 0 in 0.481s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:02 devstack sudo[88318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012 Sep 29 18:36:02 devstack sudo[88318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:02 devstack sudo[88318]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1ff4f40e-c7df-4cfd-a4fc-ae779f443012" returned: 0 in 0.276s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Lock "cinder-quobyte-1ff4f40e-c7df-4cfd-a4fc-ae779f443012" released by "delete_volume" :: held 2.378s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:02 devstack cinder-volume[86523]: WARNING cinder.quota [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:36:02 devstack cinder-volume[86523]: WARNING cinder.quota [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Created reservations ['4457dc6c-7362-4a8b-bc43-5e6d07e01512', 'e7983486-2f8c-4e3e-979e-645bf6e4fa6b', '1cf6656f-906f-4d23-a7b9-86556aad8aeb', 'cdf9bd8c-8121-4730-a5b3-ecbe8e8a6e6b'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:02 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:36:02 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:02 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.266s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:36:02 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Deleted volume successfully. Sep 29 18:36:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f9ab096b-f24a-4830-af54-e7c4a84cf308 tempest-DeleteServersTestJSON-1149970903 None] Lock "cinder-1ff4f40e-c7df-4cfd-a4fc-ae779f443012-delete_volume" released by "delete_volume" :: held 2.929s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=15,cinder:UPDATE=15,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Flow 'volume_create_manager' (4042d0f3-6ed7-4051-9a9f-af1f507ef128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8621dc-00ed-408b-8d1f-828422625e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d8621dc-00ed-408b-8d1f-828422625e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1491379225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a61e866-9c58-4033-8f8b-43c21e68c87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb4567532944bc9a29e11cbf85f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:13Z,use_quota=True,user_id='bea13e6b4c7c40fe8ec97fbe02f1d9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663f73eb-1fd7-4f84-b077-d2bb930e0c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (663f73eb-1fd7-4f84-b077-d2bb930e0c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2863ea53-2d91-4ddd-91f8-36968dd4c2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2863ea53-2d91-4ddd-91f8-36968dd4c2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a61e866-9c58-4033-8f8b-43c21e68c87c', 'volume_name': 'volume-9a61e866-9c58-4033-8f8b-43c21e68c87c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81d34ec-c372-444c-84a8-61a12e6ada43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81d34ec-c372-444c-84a8-61a12e6ada43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb06c7e-2f06-4d4b-a574-ae78737c7a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:12 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Volume 9a61e866-9c58-4033-8f8b-43c21e68c87c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a61e866-9c58-4033-8f8b-43c21e68c87c', 'volume_size': 1} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:36:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1491379225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a61e866-9c58-4033-8f8b-43c21e68c87c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb4567532944bc9a29e11cbf85f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:13Z,use_quota=True,user_id='bea13e6b4c7c40fe8ec97fbe02f1d9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Creating volume 9a61e866-9c58-4033-8f8b-43c21e68c87c {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:36:12 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:36:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9a61e866-9c58-4033-8f8b-43c21e68c87c 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:12 devstack sudo[88370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9a61e866-9c58-4033-8f8b-43c21e68c87c 1073741824 Sep 29 18:36:12 devstack sudo[88370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:13 devstack sudo[88370]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9a61e866-9c58-4033-8f8b-43c21e68c87c 1073741824" returned: 0 in 0.752s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9a61e866-9c58-4033-8f8b-43c21e68c87c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:13 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9a61e866-9c58-4033-8f8b-43c21e68c87c Sep 29 18:36:13 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:14 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9a61e866-9c58-4033-8f8b-43c21e68c87c" returned: 0 in 0.365s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] <== create_volume: return (1194ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:36:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.202s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bbb06c7e-2f06-4d4b-a574-ae78737c7a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a61e866-9c58-4033-8f8b-43c21e68c87c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26cae7e-235c-4bf0-b070-e05e8312c320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:14 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Volume volume-9a61e866-9c58-4033-8f8b-43c21e68c87c (9a61e866-9c58-4033-8f8b-43c21e68c87c): created successfully Sep 29 18:36:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26cae7e-235c-4bf0-b070-e05e8312c320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Flow 'volume_create_manager' (4042d0f3-6ed7-4051-9a9f-af1f507ef128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:36:14 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-b44230ac-fe25-48f8-88fa-26bfb5c47d94 tempest-ServerActionsTestOtherA-10905286 None] Created volume successfully. Sep 29 18:36:24 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=21,cinder:UPDATE=19,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:36:24 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:36:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-689795cd-d26a-4d7b-baa3-f1815e9196dc tempest-GroupsV320Test-254340913 None] Group tempest-GroupsV320Test-Group-1121129124: creating Sep 29 18:36:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-689795cd-d26a-4d7b-baa3-f1815e9196dc tempest-GroupsV320Test-254340913 None] Group tempest-GroupsV320Test-Group-1121129124: created successfully Sep 29 18:36:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-689795cd-d26a-4d7b-baa3-f1815e9196dc tempest-GroupsV320Test-254340913 None] Create group completed successfully. Sep 29 18:36:32 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-bd1e0aaa-4f63-4898-8e3b-2ae141c5ad20 tempest-GroupsV320Test-254340913 None] Created reservations ['e41b5b43-9809-4a79-ab36-62eac1e88837'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:36:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bd1e0aaa-4f63-4898-8e3b-2ae141c5ad20 tempest-GroupsV320Test-254340913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bd1e0aaa-4f63-4898-8e3b-2ae141c5ad20 tempest-GroupsV320Test-254340913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bd1e0aaa-4f63-4898-8e3b-2ae141c5ad20 tempest-GroupsV320Test-254340913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:36:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bd1e0aaa-4f63-4898-8e3b-2ae141c5ad20 tempest-GroupsV320Test-254340913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:36:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bd1e0aaa-4f63-4898-8e3b-2ae141c5ad20 tempest-GroupsV320Test-254340913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bd1e0aaa-4f63-4898-8e3b-2ae141c5ad20 tempest-GroupsV320Test-254340913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:32 devstack sudo[88504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:36:32 devstack sudo[88504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:32 devstack sudo[88504]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bd1e0aaa-4f63-4898-8e3b-2ae141c5ad20 tempest-GroupsV320Test-254340913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.284s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:32 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-bd1e0aaa-4f63-4898-8e3b-2ae141c5ad20 tempest-GroupsV320Test-254340913 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:36:32 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-bd1e0aaa-4f63-4898-8e3b-2ae141c5ad20 tempest-GroupsV320Test-254340913 None] Delete group completed successfully. Sep 29 18:36:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-a98df536-af28-49c2-9faf-c74714900082 req-cbc58e4e-a3de-4594-8525-a09843eb7881 tempest-TaggedAttachmentsTest-128244948 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-a98df536-af28-49c2-9faf-c74714900082 req-cbc58e4e-a3de-4594-8525-a09843eb7881 tempest-TaggedAttachmentsTest-128244948 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-a98df536-af28-49c2-9faf-c74714900082 req-cbc58e4e-a3de-4594-8525-a09843eb7881 tempest-TaggedAttachmentsTest-128244948 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-a98df536-af28-49c2-9faf-c74714900082 req-cbc58e4e-a3de-4594-8525-a09843eb7881 tempest-TaggedAttachmentsTest-128244948 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0c1e2d45-0750-4741-9909-382b47216ffc', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:36:39 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-a98df536-af28-49c2-9faf-c74714900082 req-cbc58e4e-a3de-4594-8525-a09843eb7881 tempest-TaggedAttachmentsTest-128244948 None] attachment_update completed successfully. Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Flow 'volume_create_manager' (4093d93c-43ff-4ca7-9a39-5df69086788a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b2b084-c1bd-4a4f-949a-8b82011fb166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b2b084-c1bd-4a4f-949a-8b82011fb166) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-576516610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=638a6d54-9872-42c1-bc52-804d597fce50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d720baec1e49dd9663ed5f182dd7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:44Z,use_quota=True,user_id='676a33ed90ff4746b8131cc4c89d6c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be0b313-0e91-488e-b59a-5a2e08d413da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3be0b313-0e91-488e-b59a-5a2e08d413da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d324fe-c11a-47e7-954a-ae98932bb9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d324fe-c11a-47e7-954a-ae98932bb9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '638a6d54-9872-42c1-bc52-804d597fce50', 'volume_name': 'volume-638a6d54-9872-42c1-bc52-804d597fce50', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026e714d-321b-40a5-8871-0ecf18f86dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (026e714d-321b-40a5-8871-0ecf18f86dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc59c14-abbd-41d9-bdc3-9941eae93467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:43 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Volume 638a6d54-9872-42c1-bc52-804d597fce50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-638a6d54-9872-42c1-bc52-804d597fce50', 'volume_size': 1} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:36:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-576516610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=638a6d54-9872-42c1-bc52-804d597fce50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3d720baec1e49dd9663ed5f182dd7f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:36:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:36:44Z,use_quota=True,user_id='676a33ed90ff4746b8131cc4c89d6c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Creating volume 638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:36:43 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:36:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:43 devstack sudo[89091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50 1073741824 Sep 29 18:36:43 devstack sudo[89091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:44 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-ac5eeba7-e424-482d-a0f3-06a13d0c0571 req-c60cb671-a749-484f-9563-125bedbf9ee9 tempest-TaggedAttachmentsTest-128244948 None] Terminate volume connection completed successfully. Sep 29 18:36:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-ac5eeba7-e424-482d-a0f3-06a13d0c0571 req-c60cb671-a749-484f-9563-125bedbf9ee9 tempest-TaggedAttachmentsTest-128244948 None] Deleting attachment 0c1e2d45-0750-4741-9909-382b47216ffc. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:36:44 devstack sudo[89091]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50 1073741824" returned: 0 in 0.628s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:44 devstack sudo[89124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50 Sep 29 18:36:44 devstack sudo[89124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:44 devstack sudo[89124]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50" returned: 0 in 0.340s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:36:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cc59c14-abbd-41d9-bdc3-9941eae93467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-638a6d54-9872-42c1-bc52-804d597fce50', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f999d2-74ca-4035-9a2d-3a287b24d60a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:36:44 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Volume volume-638a6d54-9872-42c1-bc52-804d597fce50 (638a6d54-9872-42c1-bc52-804d597fce50): created successfully Sep 29 18:36:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18f999d2-74ca-4035-9a2d-3a287b24d60a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:36:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Flow 'volume_create_manager' (4093d93c-43ff-4ca7-9a39-5df69086788a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:36:45 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-68973e3c-6c18-45e8-8b3d-b021a062f00e tempest-SnapshotsActionsTest-901753329 None] Created volume successfully. Sep 29 18:36:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] Creating offline snapshot 6322780c-fa45-4475-98b9-996138e85348 of volume 638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:36:46 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed248cfe-ee3f-4d52-9d5f-57ae9451771d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:46 devstack sudo[89148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50 Sep 29 18:36:46 devstack sudo[89148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:46 devstack sudo[89148]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50" returned: 0 in 0.409s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:46 devstack sudo[89153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 1G Sep 29 18:36:46 devstack sudo[89153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:47 devstack sudo[89153]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 1G" returned: 0 in 0.484s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:47 devstack sudo[89160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 Sep 29 18:36:47 devstack sudo[89160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:47 devstack sudo[89160]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348" returned: 0 in 0.296s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:47 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 is being set with open permissions: ugo+rw Sep 29 18:36:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:47 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 Sep 29 18:36:47 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:47 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348" returned: 0 in 0.261s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:47 devstack sudo[89169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.info Sep 29 18:36:47 devstack sudo[89169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:47 devstack sudo[89169]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.info" returned: 0 in 0.270s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:47 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.info is being set with open permissions: ugo+rw Sep 29 18:36:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:48 devstack sudo[89173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.info Sep 29 18:36:48 devstack sudo[89173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:48 devstack sudo[89173]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.info" returned: 0 in 0.488s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.360s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:48 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a194a38e-9936-4fc1-add7-833aa82018a8 tempest-SnapshotsActionsTest-901753329 None] Create snapshot completed successfully Sep 29 18:36:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] Creating offline snapshot 1ec1102d-8c26-46dd-a19e-1e31f5b98734 of volume 638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:36:50 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ab4bec-b773-4d08-9bbd-d1dc8d9b492a]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:50 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 Sep 29 18:36:50 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:51 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348" returned: 0 in 0.523s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638a6d54-9872-42c1-bc52-804d597fce50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:36:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:51 devstack sudo[89206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 1G Sep 29 18:36:51 devstack sudo[89206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:51 devstack sudo[89206]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 1G" returned: 0 in 0.643s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:51 devstack sudo[89213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 Sep 29 18:36:51 devstack sudo[89213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:52 devstack sudo[89213]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734" returned: 0 in 0.391s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:52 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 is being set with open permissions: ugo+rw Sep 29 18:36:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:52 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 Sep 29 18:36:52 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:52 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734" returned: 0 in 0.474s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.182s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:52 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2147091f-8b3f-4cd2-8d66-3c3e7b675c4f tempest-SnapshotsActionsTest-901753329 None] Create snapshot completed successfully Sep 29 18:36:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Acquiring lock "cinder-1ec1102d-8c26-46dd-a19e-1e31f5b98734-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-1ec1102d-8c26-46dd-a19e-1e31f5b98734-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Acquiring lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Acquiring lock "cinder-quobyte-1ec1102d-8c26-46dd-a19e-1e31f5b98734" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-1ec1102d-8c26-46dd-a19e-1e31f5b98734" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Deleting offline snapshot 1ec1102d-8c26-46dd-a19e-1e31f5b98734 of volume 638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:36:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] snapshot_file for this snap is: volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:36:53 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93b3790-5298-4593-abee-cb60434cf0f8]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:54 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 Sep 29 18:36:54 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-1633c92b-e784-4e09-a4b4-50c6c1cc0d40 req-79d2a177-1725-42be-b2df-4e027698fdb0 tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-1633c92b-e784-4e09-a4b4-50c6c1cc0d40 req-79d2a177-1725-42be-b2df-4e027698fdb0 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-1633c92b-e784-4e09-a4b4-50c6c1cc0d40 req-79d2a177-1725-42be-b2df-4e027698fdb0 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-1633c92b-e784-4e09-a4b4-50c6c1cc0d40 req-79d2a177-1725-42be-b2df-4e027698fdb0 tempest-ServerActionsTestOtherA-10905286 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-9a61e866-9c58-4033-8f8b-43c21e68c87c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8f45530-a4b4-4358-85dc-6ccef0ef627b', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:36:54 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-1633c92b-e784-4e09-a4b4-50c6c1cc0d40 req-79d2a177-1725-42be-b2df-4e027698fdb0 tempest-ServerActionsTestOtherA-10905286 None] attachment_update completed successfully. Sep 29 18:36:54 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734" returned: 0 in 0.549s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638a6d54-9872-42c1-bc52-804d597fce50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:36:54 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[84fba62b-2549-4f08-85dd-c955fc835b03]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:54 devstack sudo[89248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 Sep 29 18:36:54 devstack sudo[89248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:55 devstack sudo[89248]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348" returned: 0 in 0.592s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:55 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638a6d54-9872-42c1-bc52-804d597fce50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:36:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:55 devstack sudo[89671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 Sep 29 18:36:55 devstack sudo[89671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:55 devstack sudo[89671]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734" returned: 0 in 0.602s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:55 devstack sudo[89679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734 Sep 29 18:36:55 devstack sudo[89679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:56 devstack sudo[89679]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.1ec1102d-8c26-46dd-a19e-1e31f5b98734" returned: 0 in 0.386s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-1ec1102d-8c26-46dd-a19e-1e31f5b98734" released by "_delete_snapshot" :: held 2.314s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" released by "delete_snapshot" :: held 2.350s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:56 devstack cinder-volume[86523]: WARNING cinder.quota [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:36:56 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Created reservations ['9889ccfc-1692-4bcc-a9cc-d5b34ba355ac', '83b11e9c-f689-42bb-b690-a275ba84ecdc', 'e1a85cc6-26d8-4f6b-90c0-13a23cd31100', '61ecbb8c-c1c7-4a13-b081-be35dd97eeca'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:36:56 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Delete snapshot completed successfully. Sep 29 18:36:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c5caa0c-c67b-4906-8239-6272e04b8b74 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-1ec1102d-8c26-46dd-a19e-1e31f5b98734-delete_snapshot" released by "delete_snapshot" :: held 2.541s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Acquiring lock "cinder-3737ea19-1cb3-4d35-bdf8-08514ba8adbf-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Lock "cinder-3737ea19-1cb3-4d35-bdf8-08514ba8adbf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Acquiring lock "cinder-quobyte-3737ea19-1cb3-4d35-bdf8-08514ba8adbf" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:36:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Lock "cinder-quobyte-3737ea19-1cb3-4d35-bdf8-08514ba8adbf" acquired by "delete_volume" :: waited 0.035s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:36:57 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54e2b2c-6154-4cdf-8b06-e1370c6ab28b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:57 devstack sudo[89701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf Sep 29 18:36:57 devstack sudo[89701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] Creating offline snapshot f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 of volume 638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:36:57 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b73890-84cb-40fe-b59d-b27b4f2c2b43]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:36:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:57 devstack sudo[89701]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf" returned: 0 in 0.542s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:57 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 Sep 29 18:36:57 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:57 devstack sudo[89707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf Sep 29 18:36:57 devstack sudo[89707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:58 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348" returned: 0 in 0.460s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638a6d54-9872-42c1-bc52-804d597fce50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:58 devstack sudo[89707]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3737ea19-1cb3-4d35-bdf8-08514ba8adbf" returned: 0 in 0.398s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:58 devstack sudo[89717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 1G Sep 29 18:36:58 devstack sudo[89717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Lock "cinder-quobyte-3737ea19-1cb3-4d35-bdf8-08514ba8adbf" released by "delete_volume" :: held 1.017s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Created reservations ['2ba90471-7c28-4b70-8e0d-a7c13c9b7f2c', '9636ddeb-d6c0-4375-83b8-b4436df8e4dc', 'a06fc57a-fac5-445a-9627-babb3cbf4079', '6b68e93f-309c-441c-bba7-b61e86042601'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:58 devstack sudo[89719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:36:58 devstack sudo[89719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:58 devstack sudo[89724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:36:58 devstack sudo[89724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:58 devstack sudo[89719]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.413s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:36:59 devstack sudo[89724]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.404s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:36:59 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Deleted volume successfully. Sep 29 18:36:59 devstack sudo[89717]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 1G" returned: 0 in 0.772s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:59 devstack sudo[89742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 Sep 29 18:36:59 devstack sudo[89742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-05b5a6c9-f9b4-47ad-a297-8e3260a41097 tempest-TaggedAttachmentsTest-128244948 None] Lock "cinder-3737ea19-1cb3-4d35-bdf8-08514ba8adbf-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:36:59 devstack sudo[89742]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64" returned: 0 in 0.359s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:59 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 is being set with open permissions: ugo+rw Sep 29 18:36:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:36:59 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 Sep 29 18:36:59 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:36:59 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-6de3e658-952b-43e4-a652-2e565820cc19 req-530391fc-7405-4dea-955d-91fa4a0a348b tempest-ServerActionsTestOtherA-10905286 None] Terminate volume connection completed successfully. Sep 29 18:36:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-6de3e658-952b-43e4-a652-2e565820cc19 req-530391fc-7405-4dea-955d-91fa4a0a348b tempest-ServerActionsTestOtherA-10905286 None] Deleting attachment f8f45530-a4b4-4358-85dc-6ccef0ef627b. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:36:59 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Sep 29 18:36:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64" returned: 0 in 0.395s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:36:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.148s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:36:59 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4438e840-e9fc-4d6d-a9bf-6a6250eabc3c tempest-SnapshotsActionsTest-901753329 None] Create snapshot completed successfully Sep 29 18:37:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-6de3e658-952b-43e4-a652-2e565820cc19 req-a8561e4c-147f-46f9-9e04-e68d89975ca8 tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-6de3e658-952b-43e4-a652-2e565820cc19 req-a8561e4c-147f-46f9-9e04-e68d89975ca8 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-6de3e658-952b-43e4-a652-2e565820cc19 req-a8561e4c-147f-46f9-9e04-e68d89975ca8 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-6de3e658-952b-43e4-a652-2e565820cc19 req-a8561e4c-147f-46f9-9e04-e68d89975ca8 tempest-ServerActionsTestOtherA-10905286 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-9a61e866-9c58-4033-8f8b-43c21e68c87c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bed1753-1e9d-4e94-a688-681b97638429', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:37:00 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-6de3e658-952b-43e4-a652-2e565820cc19 req-a8561e4c-147f-46f9-9e04-e68d89975ca8 tempest-ServerActionsTestOtherA-10905286 None] attachment_update completed successfully. Sep 29 18:37:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Acquiring lock "cinder-f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Acquiring lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Acquiring lock "cinder-quobyte-f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Deleting offline snapshot f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 of volume 638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:37:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] snapshot_file for this snap is: volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:37:01 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4139fdb4-f213-47b3-8d6a-738e623a47cf]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:01 devstack sudo[89868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 Sep 29 18:37:01 devstack sudo[89868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:02 devstack sudo[89868]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64" returned: 0 in 0.597s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638a6d54-9872-42c1-bc52-804d597fce50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:37:02 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db4f82d-5ff7-4348-8b9c-1d06f4eeeaeb]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:02 devstack sudo[89905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 Sep 29 18:37:02 devstack sudo[89905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:02 devstack sudo[89905]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348" returned: 0 in 0.622s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638a6d54-9872-42c1-bc52-804d597fce50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:37:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:02 devstack sudo[89995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 Sep 29 18:37:02 devstack sudo[89995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:03 devstack sudo[89995]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64" returned: 0 in 0.948s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:03 devstack sudo[90043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64 Sep 29 18:37:03 devstack sudo[90043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:04 devstack sudo[90043]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64" returned: 0 in 0.529s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64" released by "_delete_snapshot" :: held 2.982s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" released by "delete_snapshot" :: held 3.022s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:04 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Created reservations ['71edd04a-3ad6-4bc7-935b-4ba9f01ca970', 'b14d8d98-cc0c-4b4e-ae1e-f0865aa60384', 'f165dc34-216f-4120-a4c5-48aad31f53b3', '01cab6e5-be2e-4c52-953b-2a2df53ef530'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:04 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Delete snapshot completed successfully. Sep 29 18:37:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7917814-3a61-40ae-96ff-561b1801a374 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-f0e12c4a-36c4-4fde-85ed-2fe8f6a7ec64-delete_snapshot" released by "delete_snapshot" :: held 3.276s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] Creating offline snapshot ff66b3d9-007b-44e1-a2ee-16bf357b2381 of volume 638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:37:05 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f91a8a-e669-4e92-bb5f-67a6f79dc9d9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:05 devstack sudo[90384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 Sep 29 18:37:05 devstack sudo[90384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:05 devstack sudo[90384]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348" returned: 0 in 0.504s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638a6d54-9872-42c1-bc52-804d597fce50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:37:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:06 devstack sudo[90401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 1G Sep 29 18:37:06 devstack sudo[90401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:06 devstack sudo[90401]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 1G" returned: 0 in 0.756s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:06 devstack sudo[90412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 Sep 29 18:37:06 devstack sudo[90412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Flow 'volume_create_manager' (928f6afe-5a37-4448-a30e-da3d53b3c346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f482127-4fda-4792-9704-af622bbbb844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f482127-4fda-4792-9704-af622bbbb844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1124795116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19e16fe-0cba-46dd-bf53-caf2143b4a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffdc9158b8e84e3490722d17e007f355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:07Z,use_quota=True,user_id='ad5098a9964f442380e9f7d154dece69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ff1eb1-ac5e-4868-a225-d447f69903c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ff1eb1-ac5e-4868-a225-d447f69903c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d31a9d-cc05-40f4-ae6e-9d04bdc7644e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07d31a9d-cc05-40f4-ae6e-9d04bdc7644e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a19e16fe-0cba-46dd-bf53-caf2143b4a12', 'volume_name': 'volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:07 devstack sudo[90412]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1edbe3-818b-4703-8538-caf700c2162d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b1edbe3-818b-4703-8538-caf700c2162d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d75b474-ff6f-4779-b24d-77e581d073c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:07 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Volume a19e16fe-0cba-46dd-bf53-caf2143b4a12: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12', 'volume_size': 1} Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381" returned: 0 in 0.899s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:07 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 is being set with open permissions: ugo+rw Sep 29 18:37:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:07 devstack sudo[90420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 Sep 29 18:37:07 devstack sudo[90420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:08 devstack sudo[90420]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381" returned: 0 in 0.462s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.881s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.544s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1124795116',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a19e16fe-0cba-46dd-bf53-caf2143b4a12,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ffdc9158b8e84e3490722d17e007f355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:07Z,use_quota=True,user_id='ad5098a9964f442380e9f7d154dece69',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Creating volume a19e16fe-0cba-46dd-bf53-caf2143b4a12 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:08 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:37:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:08 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12 1073741824 Sep 29 18:37:08 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-62afa76f-9081-4a3e-986d-6f938aa8532a tempest-SnapshotsActionsTest-901753329 None] Create snapshot completed successfully Sep 29 18:37:08 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Acquiring lock "cinder-ff66b3d9-007b-44e1-a2ee-16bf357b2381-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-ff66b3d9-007b-44e1-a2ee-16bf357b2381-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Acquiring lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Acquiring lock "cinder-quobyte-ff66b3d9-007b-44e1-a2ee-16bf357b2381" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-ff66b3d9-007b-44e1-a2ee-16bf357b2381" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Deleting offline snapshot ff66b3d9-007b-44e1-a2ee-16bf357b2381 of volume 638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] snapshot_file for this snap is: volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce0122a-5ca1-4309-8e0d-b62f8deffd42]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:09 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12 1073741824" returned: 0 in 1.154s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:09 devstack sudo[90431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12 Sep 29 18:37:09 devstack sudo[90431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:09 devstack sudo[90430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 Sep 29 18:37:09 devstack sudo[90430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:09 devstack sudo[90431]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12" returned: 0 in 0.448s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] <== create_volume: return (1681ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d75b474-ff6f-4779-b24d-77e581d073c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf62cd05-9af7-4ac5-8194-79e674f66a00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:09 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Volume volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12 (a19e16fe-0cba-46dd-bf53-caf2143b4a12): created successfully Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf62cd05-9af7-4ac5-8194-79e674f66a00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Flow 'volume_create_manager' (928f6afe-5a37-4448-a30e-da3d53b3c346) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:09 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-9e753a83-0eb6-4e35-9408-5d42bbac34cc tempest-VolumesAdminNegativeTest-1264718158 None] Created volume successfully. Sep 29 18:37:10 devstack sudo[90430]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381" returned: 0 in 0.992s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638a6d54-9872-42c1-bc52-804d597fce50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:37:10 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a975ef10-0a13-4395-85a5-3bcb3b1cf08a]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:10 devstack sudo[90438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 Sep 29 18:37:10 devstack sudo[90438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:10 devstack sudo[90438]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348" returned: 0 in 0.726s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638a6d54-9872-42c1-bc52-804d597fce50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:37:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:11 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 Sep 29 18:37:11 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Acquiring lock "cinder-a19e16fe-0cba-46dd-bf53-caf2143b4a12-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Lock "cinder-a19e16fe-0cba-46dd-bf53-caf2143b4a12-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Acquiring lock "cinder-quobyte-a19e16fe-0cba-46dd-bf53-caf2143b4a12" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Lock "cinder-quobyte-a19e16fe-0cba-46dd-bf53-caf2143b4a12" acquired by "delete_volume" :: waited 0.053s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:11 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dc5ebe-0da7-4410-84f8-3c9ac4b617a5]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:11 devstack sudo[90446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12 Sep 29 18:37:11 devstack sudo[90446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:11 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381" returned: 0 in 0.603s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:11 devstack sudo[90451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381 Sep 29 18:37:11 devstack sudo[90451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:11 devstack sudo[90446]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12" returned: 0 in 0.691s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:12 devstack sudo[90451]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:12 devstack sudo[90458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12 Sep 29 18:37:12 devstack sudo[90458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.ff66b3d9-007b-44e1-a2ee-16bf357b2381" returned: 0 in 0.439s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-ff66b3d9-007b-44e1-a2ee-16bf357b2381" released by "_delete_snapshot" :: held 2.888s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" released by "delete_snapshot" :: held 2.919s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Created reservations ['908b2922-698f-498c-8bd0-ecd0885ecfc9', 'cbf03aea-fff4-4200-9340-0231bcbec5e0', 'aec90476-ee34-4f80-b46e-2adc37bb8ec2', '228d1c32-0518-4dad-83f8-f360fa953e1b'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:12 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Delete snapshot completed successfully. Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1885b7c1-d1ef-47ec-9985-c4dfd5167057 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-ff66b3d9-007b-44e1-a2ee-16bf357b2381-delete_snapshot" released by "delete_snapshot" :: held 3.191s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:12 devstack sudo[90458]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a19e16fe-0cba-46dd-bf53-caf2143b4a12" returned: 0 in 0.374s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Lock "cinder-quobyte-a19e16fe-0cba-46dd-bf53-caf2143b4a12" released by "delete_volume" :: held 1.141s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Created reservations ['82ccaeaa-ce1b-405d-bf61-75e8356140c3', '43c2f254-0692-4699-b97b-bfa8122695cf', '26f9a2b2-0984-483a-bd81-3eaff902ea11', '68f46c27-e61c-4fe6-a467-bc3db214b717'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:12 devstack sudo[90462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:37:12 devstack sudo[90462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:12 devstack sudo[90462]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.325s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:12 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Deleted volume successfully. Sep 29 18:37:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a54a7419-9464-4255-a0bb-48f1931fa313 tempest-VolumesAdminNegativeTest-1264718158 None] Lock "cinder-a19e16fe-0cba-46dd-bf53-caf2143b4a12-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] Creating offline snapshot df81a112-916c-4728-aab4-7bb1a3430e5e of volume 638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:37:13 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1378aa7-ba62-4b8f-8af4-a6a05e5ce7ea]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:13 devstack sudo[90465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 Sep 29 18:37:13 devstack sudo[90465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:13 devstack sudo[90465]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348" returned: 0 in 0.689s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638a6d54-9872-42c1-bc52-804d597fce50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:37:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:13 devstack sudo[90471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e 1G Sep 29 18:37:13 devstack sudo[90471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:14 devstack sudo[90471]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e 1G" returned: 0 in 0.816s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:14 devstack sudo[90496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e Sep 29 18:37:14 devstack sudo[90496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:15 devstack sudo[90496]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e" returned: 0 in 0.524s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:15 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e is being set with open permissions: ugo+rw Sep 29 18:37:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:15 devstack sudo[90509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e Sep 29 18:37:15 devstack sudo[90509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:15 devstack sudo[90509]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e" returned: 0 in 0.505s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.657s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8c43a142-ffac-400a-9363-d35a3f58247a tempest-SnapshotsActionsTest-901753329 None] Create snapshot completed successfully Sep 29 18:37:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Acquiring lock "cinder-df81a112-916c-4728-aab4-7bb1a3430e5e-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-df81a112-916c-4728-aab4-7bb1a3430e5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Acquiring lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" acquired by "delete_snapshot" :: waited 0.043s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Acquiring lock "cinder-quobyte-df81a112-916c-4728-aab4-7bb1a3430e5e" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-df81a112-916c-4728-aab4-7bb1a3430e5e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Deleting offline snapshot df81a112-916c-4728-aab4-7bb1a3430e5e of volume 638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:37:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] snapshot_file for this snap is: volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:37:16 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0881880c-3854-463f-8eb8-6b0a3e41353a]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:16 devstack sudo[90513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e Sep 29 18:37:16 devstack sudo[90513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:17 devstack sudo[90513]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e" returned: 0 in 0.588s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638a6d54-9872-42c1-bc52-804d597fce50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:37:17 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ca838a-5444-4cfb-96da-e565bdf6b4fd]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:17 devstack sudo[90521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 Sep 29 18:37:17 devstack sudo[90521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:17 devstack sudo[90521]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348" returned: 0 in 0.500s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638a6d54-9872-42c1-bc52-804d597fce50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:37:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:17 devstack sudo[90527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e Sep 29 18:37:17 devstack sudo[90527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:18 devstack sudo[90527]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e" returned: 0 in 0.506s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:18 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e Sep 29 18:37:18 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:18 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.df81a112-916c-4728-aab4-7bb1a3430e5e" returned: 0 in 0.334s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-df81a112-916c-4728-aab4-7bb1a3430e5e" released by "_delete_snapshot" :: held 2.044s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" released by "delete_snapshot" :: held 2.086s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:18 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Created reservations ['448a5213-a760-4cd4-97a1-c3f67f50f513', 'b6d7041f-6033-4292-981b-0c1a98454f7d', '4f2ebd96-af2c-4d27-8766-cbe2b1e8e704', '11c4790b-827c-42af-b70f-af46dbd18972'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:18 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Delete snapshot completed successfully. Sep 29 18:37:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-868a6e16-54b1-46a6-aef5-f0cad891bd35 tempest-SnapshotsActionsTest-1930486139 None] Lock "cinder-df81a112-916c-4728-aab4-7bb1a3430e5e-delete_snapshot" released by "delete_snapshot" :: held 2.312s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Acquiring lock "cinder-6322780c-fa45-4475-98b9-996138e85348-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Lock "cinder-6322780c-fa45-4475-98b9-996138e85348-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Acquiring lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Acquiring lock "cinder-quobyte-6322780c-fa45-4475-98b9-996138e85348" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Lock "cinder-quobyte-6322780c-fa45-4475-98b9-996138e85348" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Deleting offline snapshot 6322780c-fa45-4475-98b9-996138e85348 of volume 638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:37:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] snapshot_file for this snap is: volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:37:20 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[300228e5-50c8-43f1-a89f-1fc67934df04]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:20 devstack sudo[90536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 Sep 29 18:37:20 devstack sudo[90536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:20 devstack sudo[90536]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348" returned: 0 in 0.534s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-638a6d54-9872-42c1-bc52-804d597fce50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:37:21 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f78283f-5f5d-4f22-9521-b54eee3be099]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:21 devstack sudo[90547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50 Sep 29 18:37:21 devstack sudo[90547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:21 devstack sudo[90547]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50" returned: 0 in 0.544s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:21 devstack sudo[90571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 Sep 29 18:37:21 devstack sudo[90571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:22 devstack sudo[90571]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348" returned: 0 in 0.436s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:22 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348 Sep 29 18:37:22 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:22 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50.6322780c-fa45-4475-98b9-996138e85348" returned: 0 in 0.294s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Lock "cinder-quobyte-6322780c-fa45-4475-98b9-996138e85348" released by "_delete_snapshot" :: held 2.012s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" released by "delete_snapshot" :: held 2.056s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:22 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Created reservations ['70b6f26c-8047-4804-ae18-ac49bacdc976', '8116280f-b841-43c4-b00e-e0db65c0d689', '9e942ee4-fc1d-440f-9289-fba7d69add1a', '89f72306-fd50-4660-8194-2e73048450c8'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:22 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Delete snapshot completed successfully. Sep 29 18:37:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2d6bf29a-d206-4e95-9c6c-00c894bdb9e9 tempest-SnapshotsActionsTest-901753329 None] Lock "cinder-6322780c-fa45-4475-98b9-996138e85348-delete_snapshot" released by "delete_snapshot" :: held 2.234s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Acquiring lock "cinder-638a6d54-9872-42c1-bc52-804d597fce50-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Lock "cinder-638a6d54-9872-42c1-bc52-804d597fce50-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Acquiring lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:23 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3113b4a2-090e-49d4-bb69-7bff90d80584]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:23 devstack sudo[90606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50 Sep 29 18:37:23 devstack sudo[90606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:24 devstack sudo[90606]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50" returned: 0 in 0.433s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:24 devstack sudo[90612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50 Sep 29 18:37:24 devstack sudo[90612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:24 devstack sudo[90612]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-638a6d54-9872-42c1-bc52-804d597fce50" returned: 0 in 0.285s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Lock "cinder-quobyte-638a6d54-9872-42c1-bc52-804d597fce50" released by "delete_volume" :: held 0.784s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=78,cinder:UPDATE=67,cinder:INSERT=16,cinder:DELETE=7 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=61,cinder:SELECT=85,cinder:INSERT=16,cinder:DELETE=2 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Created reservations ['e717736c-aa3b-4c5c-b2e7-dcbd8c3f0f49', '1d12f28c-dc41-431a-817d-95b07a9a925b', '40eb1dda-df19-4c4d-8427-e975c9e22644', '8fe029ef-be79-400c-a8fb-57e4cd3a934f'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:24 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:37:24 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:24 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.298s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:24 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:24 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Deleted volume successfully. Sep 29 18:37:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4b8bbe2e-6b68-4c96-b943-a6e86b5a5e2c tempest-SnapshotsActionsTest-901753329 None] Lock "cinder-638a6d54-9872-42c1-bc52-804d597fce50-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:34 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-901be545-450d-468e-907f-6207502254ee req-b6fd7257-bef2-414c-adc1-7b09130fc8cf tempest-ServerActionsTestOtherA-10905286 None] Terminate volume connection completed successfully. Sep 29 18:37:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-901be545-450d-468e-907f-6207502254ee req-b6fd7257-bef2-414c-adc1-7b09130fc8cf tempest-ServerActionsTestOtherA-10905286 None] Deleting attachment 9bed1753-1e9d-4e94-a688-681b97638429. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:37:43 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Flow 'volume_create_manager' (d27ee87c-6938-49d2-b6ae-da08f5901f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc73da41-d386-4781-8db2-faaec52e30c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc73da41-d386-4781-8db2-faaec52e30c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-788552333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade65269-9276-4756-911e-0a2564824757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb4567532944bc9a29e11cbf85f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:44Z,use_quota=True,user_id='bea13e6b4c7c40fe8ec97fbe02f1d9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9a56c0-2126-421d-a934-37bdcdb6ec4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce9a56c0-2126-421d-a934-37bdcdb6ec4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8096cf-04bc-4c17-ba9e-8c383d6f3e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:43 devstack cinder-volume[86523]: DEBUG cinder.image.glance [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Creating Keystone auth plugin from conf {{(pid=86523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:37:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc8096cf-04bc-4c17-ba9e-8c383d6f3e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ade65269-9276-4756-911e-0a2564824757', 'volume_name': 'volume-ade65269-9276-4756-911e-0a2564824757', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f49130-3d41-49b6-83b6-08593912444f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07f49130-3d41-49b6-83b6-08593912444f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd05532-2ce3-4d85-8584-8f90f73fc7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:44 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Volume ade65269-9276-4756-911e-0a2564824757: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ade65269-9276-4756-911e-0a2564824757', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 18:37:44 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Trying to clone ade65269-9276-4756-911e-0a2564824757 from image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]). {{(pid=86523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:37:45 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:37:45 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Image download 20.69 MB at 20.69 MB/s Sep 29 18:37:45 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[762590bb-5667-4a18-83d1-11d73025e24e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:45 devstack sudo[90834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD Sep 29 18:37:45 devstack sudo[90834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:46 devstack sudo[90834]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD" returned: 0 in 0.522s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Temporary image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 is fetched for user bea13e6b4c7c40fe8ec97fbe02f1d9b8. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf81f60-cc6d-4da6-b89e-5be68bb92774]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:46 devstack sudo[90851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD Sep 29 18:37:46 devstack sudo[90851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:46 devstack sudo[90851]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD" returned: 0 in 0.409s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-788552333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ade65269-9276-4756-911e-0a2564824757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fdb4567532944bc9a29e11cbf85f291e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:44Z,use_quota=True,user_id='bea13e6b4c7c40fe8ec97fbe02f1d9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Creating volume ade65269-9276-4756-911e-0a2564824757 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:46 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:46 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 1073741824 Sep 29 18:37:46 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Flow 'volume_create_manager' (776411bd-43d1-4c69-b0f3-1cc7b4145807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869260bc-b5b4-44f5-9e5c-bc277f148962) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (869260bc-b5b4-44f5-9e5c-bc277f148962) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2110459599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf66dcc7-8191-4872-9fa8-a5905eea8e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56e10b8f0a472f9eb8f6c17ff19ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:47Z,use_quota=True,user_id='e7419ce0ea5646cb9b5c4ff35dddcb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af04e922-72ad-46f6-8a8e-10eb81cbd41b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af04e922-72ad-46f6-8a8e-10eb81cbd41b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a63409-e023-4074-bef0-8fbd7cb17d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35a63409-e023-4074-bef0-8fbd7cb17d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf66dcc7-8191-4872-9fa8-a5905eea8e9a', 'volume_name': 'volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7581ad5c-17e3-499c-af03-8e2c59750d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7581ad5c-17e3-499c-af03-8e2c59750d36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e41b50d3-be83-46c8-8d17-07c0f7172724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:46 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Volume bf66dcc7-8191-4872-9fa8-a5905eea8e9a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a', 'volume_size': 1} Sep 29 18:37:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:47 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 1073741824" returned: 0 in 0.696s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:47 devstack sudo[90865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 Sep 29 18:37:47 devstack sudo[90865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:47 devstack sudo[90865]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757" returned: 0 in 0.305s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.083s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.812s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2110459599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf66dcc7-8191-4872-9fa8-a5905eea8e9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56e10b8f0a472f9eb8f6c17ff19ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:47Z,use_quota=True,user_id='e7419ce0ea5646cb9b5c4ff35dddcb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Creating volume bf66dcc7-8191-4872-9fa8-a5905eea8e9a {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:47 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:47 devstack sudo[90868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a 1073741824 Sep 29 18:37:47 devstack sudo[90868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Attempting download of 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 ((None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}])) to volume ade65269-9276-4756-911e-0a2564824757. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a2abef1-c9e5-433b-b055-93b9d2319c82]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_9ec4tln4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:48 devstack sudo[90870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_9ec4tln4 Sep 29 18:37:48 devstack sudo[90870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:48 devstack sudo[90870]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_9ec4tln4" returned: 0 in 0.443s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_9ec4tln4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:48 devstack sudo[90868]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a 1073741824" returned: 0 in 0.559s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:48 devstack sudo[90879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a Sep 29 18:37:48 devstack sudo[90879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:48 devstack sudo[90878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_9ec4tln4 Sep 29 18:37:48 devstack sudo[90878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:48 devstack sudo[90878]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_9ec4tln4" returned: 1 in 0.483s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_9ec4tln4' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b493d0-7d21-44c9-90f1-f1c5b21f1a3e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:48 devstack sudo[90879]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a" returned: 0 in 0.446s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] <== create_volume: return (1072ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.076s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e41b50d3-be83-46c8-8d17-07c0f7172724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f819d0-fe17-4a28-b102-7b79355dcd21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:48 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Volume volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a (bf66dcc7-8191-4872-9fa8-a5905eea8e9a): created successfully Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0f819d0-fe17-4a28-b102-7b79355dcd21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Flow 'volume_create_manager' (776411bd-43d1-4c69-b0f3-1cc7b4145807) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:48 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d5694330-9cb3-46ff-aa95-9f61db7a69c2 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Created volume successfully. Sep 29 18:37:49 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD Sep 29 18:37:49 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:49 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:49 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 was qcow2, converting to qcow2 {{(pid=86523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:37:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:49 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 Sep 29 18:37:49 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Acquiring lock "cinder-bf66dcc7-8191-4872-9fa8-a5905eea8e9a-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "cinder-bf66dcc7-8191-4872-9fa8-a5905eea8e9a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Acquiring lock "cinder-quobyte-bf66dcc7-8191-4872-9fa8-a5905eea8e9a" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "cinder-quobyte-bf66dcc7-8191-4872-9fa8-a5905eea8e9a" acquired by "delete_volume" :: waited 0.040s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:50 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f371b021-98fa-4490-a16d-e1114d53bab8]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:50 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a Sep 29 18:37:50 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:51 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a" returned: 0 in 0.631s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:51 devstack sudo[90906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a Sep 29 18:37:51 devstack sudo[90906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:51 devstack sudo[90906]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf66dcc7-8191-4872-9fa8-a5905eea8e9a" returned: 0 in 0.451s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "cinder-quobyte-bf66dcc7-8191-4872-9fa8-a5905eea8e9a" released by "delete_volume" :: held 1.148s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:51 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Created reservations ['8c253d1f-2049-4bea-bb12-f7427119a384', 'ce4370f0-8c3f-40ce-a091-3c5d3134d935', '5d89b009-ae27-4a18-a8f7-42c5ca42b1e8', 'ae3933c3-5064-496d-86a1-65b3e9a371f5'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:52 devstack sudo[90909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:37:52 devstack sudo[90909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:52 devstack sudo[90909]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.557s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:52 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:52 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Deleted volume successfully. Sep 29 18:37:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b078307e-7031-47d9-9597-a42ce98259ce tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "cinder-bf66dcc7-8191-4872-9fa8-a5905eea8e9a-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:52 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757" returned: 0 in 3.293s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:52 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_df4rau38devstack@QuobyteHD, size 112.00 MB, duration 3.29 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:37:52 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Converted 112.00 MB image at 33.99 MB/s Sep 29 18:37:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:52 devstack sudo[90913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 1G Sep 29 18:37:52 devstack sudo[90913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:53 devstack sudo[90913]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 1G" returned: 0 in 0.527s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Downloaded image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 ((None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}])) to volume ade65269-9276-4756-911e-0a2564824757 successfully. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Temporary image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 for user bea13e6b4c7c40fe8ec97fbe02f1d9b8 is deleted. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Marking volume ade65269-9276-4756-911e-0a2564824757 as bootable. {{(pid=86523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Copying metadata from image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 to ade65269-9276-4756-911e-0a2564824757. {{(pid=86523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Creating volume glance metadata for volume ade65269-9276-4756-911e-0a2564824757 backed by image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fd05532-2ce3-4d85-8584-8f90f73fc7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ade65269-9276-4756-911e-0a2564824757', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90a8a3d-96ff-4851-8874-708464738f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:53 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Volume volume-ade65269-9276-4756-911e-0a2564824757 (ade65269-9276-4756-911e-0a2564824757): created successfully Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f90a8a3d-96ff-4851-8874-708464738f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Flow 'volume_create_manager' (d27ee87c-6938-49d2-b6ae-da08f5901f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:53 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-af2c7465-7d27-4510-b262-415f092ff461 tempest-ServerActionsTestOtherA-10905286 None] Created volume successfully. Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Flow 'volume_create_manager' (68c94296-849e-431a-880b-9f11cfebabdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f75555f-07f5-4632-b3fa-628484097b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f75555f-07f5-4632-b3fa-628484097b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-127351293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc720c9-b2eb-46e3-81e2-ff619b9c197d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56e10b8f0a472f9eb8f6c17ff19ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:53Z,use_quota=True,user_id='e7419ce0ea5646cb9b5c4ff35dddcb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd53b73-33c4-441b-8ff8-277fc8ea27be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fcd53b73-33c4-441b-8ff8-277fc8ea27be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbefce6-5754-4f74-9f6a-373751bb7c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbefce6-5754-4f74-9f6a-373751bb7c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc720c9-b2eb-46e3-81e2-ff619b9c197d', 'volume_name': 'volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceeec266-2613-4598-9f60-ed520384cb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceeec266-2613-4598-9f60-ed520384cb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c395823-45d8-47b4-82b6-403567554f10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:53 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Volume 0cc720c9-b2eb-46e3-81e2-ff619b9c197d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d', 'volume_size': 1} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:37:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-127351293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc720c9-b2eb-46e3-81e2-ff619b9c197d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c56e10b8f0a472f9eb8f6c17ff19ce4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:37:53Z,use_quota=True,user_id='e7419ce0ea5646cb9b5c4ff35dddcb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Creating volume 0cc720c9-b2eb-46e3-81e2-ff619b9c197d {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:37:53 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:37:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:53 devstack sudo[90920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d 1073741824 Sep 29 18:37:53 devstack sudo[90920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:54 devstack sudo[90920]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d 1073741824" returned: 0 in 0.626s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:54 devstack sudo[90926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d Sep 29 18:37:54 devstack sudo[90926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:54 devstack sudo[90926]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d" returned: 0 in 0.525s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] <== create_volume: return (1219ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:37:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.223s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c395823-45d8-47b4-82b6-403567554f10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85187f7a-0769-4ba9-9ba1-f6acfef4a4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:37:54 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Volume volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d (0cc720c9-b2eb-46e3-81e2-ff619b9c197d): created successfully Sep 29 18:37:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85187f7a-0769-4ba9-9ba1-f6acfef4a4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:37:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Flow 'volume_create_manager' (68c94296-849e-431a-880b-9f11cfebabdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:37:54 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e2054fb1-be25-402a-a60f-87d309eedbe0 tempest-VolumeQuotasAdminTestJSON-2065739113 None] Created volume successfully. Sep 29 18:37:56 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7b77ed3d-607e-49c7-a661-99cfd06b28a1 tempest-VolumeQuotasAdminTestJSON-8728102 None] Transfer volume completed successfully. Sep 29 18:37:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Acquiring lock "cinder-0cc720c9-b2eb-46e3-81e2-ff619b9c197d-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Lock "cinder-0cc720c9-b2eb-46e3-81e2-ff619b9c197d-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Acquiring lock "cinder-quobyte-0cc720c9-b2eb-46e3-81e2-ff619b9c197d" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:37:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Lock "cinder-quobyte-0cc720c9-b2eb-46e3-81e2-ff619b9c197d" acquired by "delete_volume" :: waited 0.033s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:37:57 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebcd9687-3a5b-4e4a-9cf0-daf46de4fcb9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:37:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-63c0c85a-7d6c-4028-9392-13d220f43d2c req-98275314-bfe0-4c66-b6bf-97b285fdb8ad tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-63c0c85a-7d6c-4028-9392-13d220f43d2c req-98275314-bfe0-4c66-b6bf-97b285fdb8ad tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:57 devstack sudo[90942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d Sep 29 18:37:57 devstack sudo[90942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-63c0c85a-7d6c-4028-9392-13d220f43d2c req-98275314-bfe0-4c66-b6bf-97b285fdb8ad tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-63c0c85a-7d6c-4028-9392-13d220f43d2c req-98275314-bfe0-4c66-b6bf-97b285fdb8ad tempest-ServerActionsTestOtherA-10905286 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-ade65269-9276-4756-911e-0a2564824757', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd92b7639-8333-4705-a50c-556c327252cb', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:37:58 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-63c0c85a-7d6c-4028-9392-13d220f43d2c req-98275314-bfe0-4c66-b6bf-97b285fdb8ad tempest-ServerActionsTestOtherA-10905286 None] attachment_update completed successfully. Sep 29 18:37:58 devstack sudo[90942]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d" returned: 0 in 0.714s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:58 devstack sudo[90947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d Sep 29 18:37:58 devstack sudo[90947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:37:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:58 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:37:58 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:58 devstack sudo[90947]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cc720c9-b2eb-46e3-81e2-ff619b9c197d" returned: 0 in 0.501s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Lock "cinder-quobyte-0cc720c9-b2eb-46e3-81e2-ff619b9c197d" released by "delete_volume" :: held 1.330s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:37:59 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.553s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Created reservations ['699667ed-a8d3-4297-9725-435b378f4816', '336c8c87-073c-4d15-a362-fdcda8592af4', '57cc5940-6471-4e28-8117-d4e428ba48d5', '5dede4db-7baf-429c-80bc-d3d281d4dc23'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:37:59 devstack sudo[90959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:37:59 devstack sudo[90959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:37:59 devstack sudo[90959]: pam_unix(sudo:session): session closed for user root Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.355s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:37:59 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Deleted volume successfully. Sep 29 18:37:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f9b59c1a-654b-4434-88fc-a57db5d40ac8 tempest-VolumeQuotasAdminTestJSON-1823866111 None] Lock "cinder-0cc720c9-b2eb-46e3-81e2-ff619b9c197d-delete_volume" released by "delete_volume" :: held 2.178s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:09 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=36,cinder:SELECT=29,cinder:DELETE=3,cinder:INSERT=11 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:38:09 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=40,cinder:INSERT=17,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Flow 'volume_create_manager' (fc164a20-f852-4bbd-a2f7-4c1b9398cb5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903bfe17-1d9e-433e-a5e7-34f848623f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903bfe17-1d9e-433e-a5e7-34f848623f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2114464857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48d0555-7604-466b-b79e-0bb6684c82bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb4a1f9726d47cd8e87418ca82b088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:12Z,use_quota=True,user_id='2b4682d27425436086324ded3142e5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c2e7b2-30d4-4d9e-ac3f-2ac2e5655fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7c2e7b2-30d4-4d9e-ac3f-2ac2e5655fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8724703-59d1-475c-9765-a58ade67b646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8724703-59d1-475c-9765-a58ade67b646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e48d0555-7604-466b-b79e-0bb6684c82bd', 'volume_name': 'volume-e48d0555-7604-466b-b79e-0bb6684c82bd', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b14b716-80e3-4387-b266-3490e7b39b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b14b716-80e3-4387-b266-3490e7b39b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56ce409-2fe7-4239-8c4a-d9eb9c8044de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:12 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Volume e48d0555-7604-466b-b79e-0bb6684c82bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e48d0555-7604-466b-b79e-0bb6684c82bd', 'volume_size': 1} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2114464857',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e48d0555-7604-466b-b79e-0bb6684c82bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4cb4a1f9726d47cd8e87418ca82b088d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:12Z,use_quota=True,user_id='2b4682d27425436086324ded3142e5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Creating volume e48d0555-7604-466b-b79e-0bb6684c82bd {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:12 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:38:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e48d0555-7604-466b-b79e-0bb6684c82bd 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:12 devstack sudo[91486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e48d0555-7604-466b-b79e-0bb6684c82bd 1073741824 Sep 29 18:38:12 devstack sudo[91486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Flow 'volume_create_manager' (5635986e-8315-4e90-9520-3518c1db16fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:13 devstack sudo[91486]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf1f214-297f-443a-aa41-df07e2e0dee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e48d0555-7604-466b-b79e-0bb6684c82bd 1073741824" returned: 0 in 1.071s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cf1f214-297f-443a-aa41-df07e2e0dee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2125805914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a4daacc-08fe-4f2f-8754-f28b0e035f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a875a39661e4d0da20cf2318c538036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:13Z,use_quota=True,user_id='14e02c5f829744d8b0f40875391b5f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320173e9-af9e-43e9-b114-e8f2ed4422dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320173e9-af9e-43e9-b114-e8f2ed4422dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb53839-bd3d-4149-b154-08241f180229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fb53839-bd3d-4149-b154-08241f180229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a4daacc-08fe-4f2f-8754-f28b0e035f5c', 'volume_name': 'volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf876dd2-0135-487e-9cf2-b7c6020b1916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf876dd2-0135-487e-9cf2-b7c6020b1916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cc979e-fda4-4c0d-aecf-f7dae511c1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:13 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Volume 8a4daacc-08fe-4f2f-8754-f28b0e035f5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c', 'volume_size': 1} Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e48d0555-7604-466b-b79e-0bb6684c82bd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:13 devstack sudo[91495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e48d0555-7604-466b-b79e-0bb6684c82bd Sep 29 18:38:13 devstack sudo[91495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:14 devstack sudo[91495]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e48d0555-7604-466b-b79e-0bb6684c82bd" returned: 0 in 0.772s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] <== create_volume: return (2134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.839s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2125805914',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a4daacc-08fe-4f2f-8754-f28b0e035f5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a875a39661e4d0da20cf2318c538036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:13Z,use_quota=True,user_id='14e02c5f829744d8b0f40875391b5f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Creating volume 8a4daacc-08fe-4f2f-8754-f28b0e035f5c {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:14 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e56ce409-2fe7-4239-8c4a-d9eb9c8044de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e48d0555-7604-466b-b79e-0bb6684c82bd', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb72dcf-e108-40a5-b3d1-f30b23578820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:14 devstack sudo[91533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c 1073741824 Sep 29 18:38:14 devstack sudo[91533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:14 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Volume volume-e48d0555-7604-466b-b79e-0bb6684c82bd (e48d0555-7604-466b-b79e-0bb6684c82bd): created successfully Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb72dcf-e108-40a5-b3d1-f30b23578820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Flow 'volume_create_manager' (fc164a20-f852-4bbd-a2f7-4c1b9398cb5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:14 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-c5ae52df-ae7e-47d3-9c8b-7e5c70a9b40e tempest-VolumesServicesTestJSON-1010170050 None] Created volume successfully. Sep 29 18:38:15 devstack sudo[91533]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c 1073741824" returned: 0 in 1.465s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:16 devstack sudo[91578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c Sep 29 18:38:16 devstack sudo[91578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Acquiring lock "cinder-e48d0555-7604-466b-b79e-0bb6684c82bd-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Lock "cinder-e48d0555-7604-466b-b79e-0bb6684c82bd-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Acquiring lock "cinder-quobyte-e48d0555-7604-466b-b79e-0bb6684c82bd" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Lock "cinder-quobyte-e48d0555-7604-466b-b79e-0bb6684c82bd" acquired by "delete_volume" :: waited 0.032s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:16 devstack sudo[91578]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c" returned: 0 in 0.542s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] <== create_volume: return (2142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2cc979e-fda4-4c0d-aecf-f7dae511c1a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f9e3f7-1afc-4aab-ae6c-d4f08e3bc7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f27090-06a6-4df1-91ea-f34d6865216b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e48d0555-7604-466b-b79e-0bb6684c82bd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:16 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Volume volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c (8a4daacc-08fe-4f2f-8754-f28b0e035f5c): created successfully Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1f9e3f7-1afc-4aab-ae6c-d4f08e3bc7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Flow 'volume_create_manager' (5635986e-8315-4e90-9520-3518c1db16fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:16 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-21744e9c-a683-4ca0-b403-9cd779c4ddb3 tempest-AttachVolumeTestJSON-226085023 None] Created volume successfully. Sep 29 18:38:16 devstack sudo[91592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e48d0555-7604-466b-b79e-0bb6684c82bd Sep 29 18:38:16 devstack sudo[91592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:17 devstack sudo[91592]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e48d0555-7604-466b-b79e-0bb6684c82bd" returned: 0 in 0.646s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e48d0555-7604-466b-b79e-0bb6684c82bd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:17 devstack sudo[91598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e48d0555-7604-466b-b79e-0bb6684c82bd Sep 29 18:38:17 devstack sudo[91598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:17 devstack sudo[91598]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e48d0555-7604-466b-b79e-0bb6684c82bd" returned: 0 in 0.492s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Lock "cinder-quobyte-e48d0555-7604-466b-b79e-0bb6684c82bd" released by "delete_volume" :: held 1.301s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:18 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Created reservations ['43d790cd-0091-4259-9424-9ace28e95bea', '67742e1f-39b8-4df3-b2b0-6e6e14b6ef59', '1dd9790d-3aac-4b03-90d8-e5fc140d275b', '0333e004-c630-4ed6-bf19-4bf09ac1fc35'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:18 devstack sudo[91607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:38:18 devstack sudo[91607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:19 devstack sudo[91607]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.866s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:19 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:19 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Deleted volume successfully. Sep 29 18:38:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3c7a8760-f14d-46e2-87cb-bc789227025c tempest-VolumesServicesTestJSON-1010170050 None] Lock "cinder-e48d0555-7604-466b-b79e-0bb6684c82bd-delete_volume" released by "delete_volume" :: held 3.002s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-342a3810-852b-49fd-97b6-8e80bbf73a35 req-d3f189ef-822a-44eb-9320-5f8b669ef92f tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-342a3810-852b-49fd-97b6-8e80bbf73a35 req-d3f189ef-822a-44eb-9320-5f8b669ef92f tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-342a3810-852b-49fd-97b6-8e80bbf73a35 req-d3f189ef-822a-44eb-9320-5f8b669ef92f tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-342a3810-852b-49fd-97b6-8e80bbf73a35 req-d3f189ef-822a-44eb-9320-5f8b669ef92f tempest-AttachVolumeTestJSON-226085023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21d92290-d047-448c-9df1-c3c5c26dc2ac', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:38:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-342a3810-852b-49fd-97b6-8e80bbf73a35 req-d3f189ef-822a-44eb-9320-5f8b669ef92f tempest-AttachVolumeTestJSON-226085023 None] attachment_update completed successfully. Sep 29 18:38:22 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-b1faa6a4-0249-4cb2-9a45-e5f8ec837329 req-39363fb7-6225-41c4-b530-145e05d819fd tempest-ServerActionsTestOtherA-10905286 None] Terminate volume connection completed successfully. Sep 29 18:38:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-b1faa6a4-0249-4cb2-9a45-e5f8ec837329 req-39363fb7-6225-41c4-b530-145e05d819fd tempest-ServerActionsTestOtherA-10905286 None] Deleting attachment d92b7639-8333-4705-a50c-556c327252cb. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:38:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-b1faa6a4-0249-4cb2-9a45-e5f8ec837329 req-1a5fd006-2e08-4a8b-a256-1a66d6f67bd5 tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-b1faa6a4-0249-4cb2-9a45-e5f8ec837329 req-1a5fd006-2e08-4a8b-a256-1a66d6f67bd5 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-b1faa6a4-0249-4cb2-9a45-e5f8ec837329 req-1a5fd006-2e08-4a8b-a256-1a66d6f67bd5 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-b1faa6a4-0249-4cb2-9a45-e5f8ec837329 req-1a5fd006-2e08-4a8b-a256-1a66d6f67bd5 tempest-ServerActionsTestOtherA-10905286 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-ade65269-9276-4756-911e-0a2564824757', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2db55728-91af-477d-b0e2-162c795077c8', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:38:24 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-b1faa6a4-0249-4cb2-9a45-e5f8ec837329 req-1a5fd006-2e08-4a8b-a256-1a66d6f67bd5 tempest-ServerActionsTestOtherA-10905286 None] attachment_update completed successfully. Sep 29 18:38:32 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-070148a5-7d8a-478f-aef2-1f32caa04ffe tempest-ServerActionsTestOtherA-10905286 None] Terminate volume connection completed successfully. Sep 29 18:38:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-070148a5-7d8a-478f-aef2-1f32caa04ffe tempest-ServerActionsTestOtherA-10905286 None] Deleting attachment 2db55728-91af-477d-b0e2-162c795077c8. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:38:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "cinder-ade65269-9276-4756-911e-0a2564824757-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Lock "cinder-ade65269-9276-4756-911e-0a2564824757-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "cinder-quobyte-ade65269-9276-4756-911e-0a2564824757" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Lock "cinder-quobyte-ade65269-9276-4756-911e-0a2564824757" acquired by "delete_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:33 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3ad694-7e55-47bb-95f9-3743728fb9b7]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:33 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 Sep 29 18:38:33 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:33 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757" returned: 0 in 0.607s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:33 devstack sudo[92341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757 Sep 29 18:38:33 devstack sudo[92341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:34 devstack sudo[92341]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ade65269-9276-4756-911e-0a2564824757" returned: 0 in 0.307s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Lock "cinder-quobyte-ade65269-9276-4756-911e-0a2564824757" released by "delete_volume" :: held 0.981s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG cinder.quota [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Created reservations ['172654e4-bebf-4ace-a692-4090e7a97e78', 'bf179584-a579-4cd1-9d02-a6eceecc666b', '73c49c0f-82f7-4a45-b4c6-f95bd7c051fe', 'bbf20531-3655-4cd6-8586-820da8d0a921'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:34 devstack sudo[92348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:38:34 devstack sudo[92348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:34 devstack sudo[92348]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.298s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG cinder.manager [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:34 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Deleted volume successfully. Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-e3ca7c73-dcd5-4b7b-94cb-eef828af8e67 req-f622c577-fd86-45ff-8803-313b0157aaa5 tempest-ServerActionsTestOtherA-10905286 None] Lock "cinder-ade65269-9276-4756-911e-0a2564824757-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "cinder-9a61e866-9c58-4033-8f8b-43c21e68c87c-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Lock "cinder-9a61e866-9c58-4033-8f8b-43c21e68c87c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "cinder-quobyte-9a61e866-9c58-4033-8f8b-43c21e68c87c" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Lock "cinder-quobyte-9a61e866-9c58-4033-8f8b-43c21e68c87c" acquired by "delete_volume" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1c799f-cd24-47d9-9f09-f92f01dad8d4]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9a61e866-9c58-4033-8f8b-43c21e68c87c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:35 devstack sudo[92352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9a61e866-9c58-4033-8f8b-43c21e68c87c Sep 29 18:38:35 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:35 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9a61e866-9c58-4033-8f8b-43c21e68c87c" returned: 0 in 0.382s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9a61e866-9c58-4033-8f8b-43c21e68c87c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:35 devstack sudo[92357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9a61e866-9c58-4033-8f8b-43c21e68c87c Sep 29 18:38:35 devstack sudo[92357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:35 devstack sudo[92357]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9a61e866-9c58-4033-8f8b-43c21e68c87c" returned: 0 in 0.266s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Lock "cinder-quobyte-9a61e866-9c58-4033-8f8b-43c21e68c87c" released by "delete_volume" :: held 0.697s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:35 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Created reservations ['ff3674d4-ae4d-4f60-93d3-3feff9ee375f', '5da99fa0-d5f7-4bba-aa93-a256b0367633', '6be0e765-5ed7-4d64-8193-2523b0ca368b', '26a577bb-8f1c-431e-adfe-6319b42cead8'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:35 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:38:35 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:36 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.254s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:36 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:36 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Deleted volume successfully. Sep 29 18:38:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5b52a4b-db2b-4554-b4ea-07cd1c48ef2b tempest-ServerActionsTestOtherA-10905286 None] Lock "cinder-9a61e866-9c58-4033-8f8b-43c21e68c87c-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Flow 'volume_create_manager' (ec43a1a8-1354-409a-abc1-aac3c81c017b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54490648-4416-4839-aad4-de0cd6567662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54490648-4416-4839-aad4-de0cd6567662) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-353059854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10571a25-5523-450f-9b70-0dbf1ee88cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3b0a713b3745439b3542c7340e8b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:39Z,use_quota=True,user_id='c637e9038b484517b3cc46a4ad1f5174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df55d9fa-adf5-4a40-a91f-7256d8b84178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df55d9fa-adf5-4a40-a91f-7256d8b84178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ecbd5d-4abb-4525-8d3f-6b73814fa410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6ecbd5d-4abb-4525-8d3f-6b73814fa410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10571a25-5523-450f-9b70-0dbf1ee88cfc', 'volume_name': 'volume-10571a25-5523-450f-9b70-0dbf1ee88cfc', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7067bea1-6500-4bda-865a-e26b5d3404ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7067bea1-6500-4bda-865a-e26b5d3404ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecf2d2e-cb42-4179-98d4-23ff38dff154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:39 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Volume 10571a25-5523-450f-9b70-0dbf1ee88cfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10571a25-5523-450f-9b70-0dbf1ee88cfc', 'volume_size': 1} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-353059854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10571a25-5523-450f-9b70-0dbf1ee88cfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf3b0a713b3745439b3542c7340e8b9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:39Z,use_quota=True,user_id='c637e9038b484517b3cc46a4ad1f5174',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Creating volume 10571a25-5523-450f-9b70-0dbf1ee88cfc {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:39 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:39 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc 1073741824 Sep 29 18:38:39 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:39 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc 1073741824" returned: 0 in 0.405s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:39 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc Sep 29 18:38:39 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:40 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc" returned: 0 in 0.229s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ecf2d2e-cb42-4179-98d4-23ff38dff154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10571a25-5523-450f-9b70-0dbf1ee88cfc', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61587f3-8817-4571-a358-c056c9423718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:40 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Volume volume-10571a25-5523-450f-9b70-0dbf1ee88cfc (10571a25-5523-450f-9b70-0dbf1ee88cfc): created successfully Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c61587f3-8817-4571-a358-c056c9423718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Flow 'volume_create_manager' (ec43a1a8-1354-409a-abc1-aac3c81c017b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:40 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-004666bd-b016-436d-94ba-6bfe06f72a1c tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Created volume successfully. Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Creating offline snapshot 4a3e3b36-2259-4fa9-8c12-e2962f55daa3 of volume 10571a25-5523-450f-9b70-0dbf1ee88cfc {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb894792-72e5-412a-accf-34bb11806cad]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:40 devstack sudo[92402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc Sep 29 18:38:40 devstack sudo[92402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:40 devstack sudo[92402]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc" returned: 0 in 0.368s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:40 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 1G Sep 29 18:38:40 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:41 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 1G" returned: 0 in 0.404s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10571a25-5523-450f-9b70-0dbf1ee88cfc -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:41 devstack sudo[92413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10571a25-5523-450f-9b70-0dbf1ee88cfc -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 Sep 29 18:38:41 devstack sudo[92413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:41 devstack sudo[92413]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-10571a25-5523-450f-9b70-0dbf1ee88cfc -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3" returned: 0 in 0.376s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:41 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 is being set with open permissions: ugo+rw Sep 29 18:38:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:41 devstack sudo[92419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 Sep 29 18:38:41 devstack sudo[92419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:41 devstack sudo[92419]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3" returned: 0 in 0.254s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:41 devstack sudo[92422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.info Sep 29 18:38:41 devstack sudo[92422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:42 devstack sudo[92422]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.info" returned: 0 in 0.256s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:42 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.info is being set with open permissions: ugo+rw Sep 29 18:38:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:42 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.info Sep 29 18:38:42 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:42 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.info" returned: 0 in 0.318s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:42 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-38628144-6fbc-46b5-b21f-d70e35deb549 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Create snapshot completed successfully Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Flow 'volume_create_manager' (174ca9ba-2f33-474d-bab7-52e2e9a31eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7345fb0-c91c-4d18-b633-65cd85faee91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7345fb0-c91c-4d18-b633-65cd85faee91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-56872135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9eb495-eace-487e-a8c5-6739d5f8bcea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af79d9e5f5491196833d7408ee4e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:43Z,use_quota=True,user_id='88669c06956249c4be7274bd1568531e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512913b9-31fa-4822-9984-81e617d7239d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (512913b9-31fa-4822-9984-81e617d7239d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c52779-3c19-4dd7-a0f5-d1799a21190a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55c52779-3c19-4dd7-a0f5-d1799a21190a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b9eb495-eace-487e-a8c5-6739d5f8bcea', 'volume_name': 'volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786c33bc-aae1-4a58-96a9-3763d8cdd852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (786c33bc-aae1-4a58-96a9-3763d8cdd852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1eaa8e-c6c3-4d88-be60-4bbe0e94c7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:43 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Volume 6b9eb495-eace-487e-a8c5-6739d5f8bcea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea', 'volume_size': 1} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:38:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-56872135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b9eb495-eace-487e-a8c5-6739d5f8bcea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4af79d9e5f5491196833d7408ee4e60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:38:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:38:43Z,use_quota=True,user_id='88669c06956249c4be7274bd1568531e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Creating volume 6b9eb495-eace-487e-a8c5-6739d5f8bcea {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:38:43 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:38:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:43 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea 1073741824 Sep 29 18:38:43 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:44 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Acquiring lock "cinder-4a3e3b36-2259-4fa9-8c12-e2962f55daa3-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea 1073741824" returned: 0 in 0.525s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "cinder-4a3e3b36-2259-4fa9-8c12-e2962f55daa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Acquiring lock "cinder-quobyte-10571a25-5523-450f-9b70-0dbf1ee88cfc" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "cinder-quobyte-10571a25-5523-450f-9b70-0dbf1ee88cfc" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Acquiring lock "cinder-quobyte-4a3e3b36-2259-4fa9-8c12-e2962f55daa3" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "cinder-quobyte-4a3e3b36-2259-4fa9-8c12-e2962f55daa3" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Deleting offline snapshot 4a3e3b36-2259-4fa9-8c12-e2962f55daa3 of volume 10571a25-5523-450f-9b70-0dbf1ee88cfc {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:38:44 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea Sep 29 18:38:44 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] snapshot_file for this snap is: volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e370b526-37d8-4e89-a446-50510cfcbdb1]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:44 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 Sep 29 18:38:44 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:44 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea" returned: 0 in 0.300s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.900s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a1eaa8e-c6c3-4d88-be60-4bbe0e94c7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5701d79-6efc-4466-af1f-ef7219ba1a4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:38:44 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Volume volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea (6b9eb495-eace-487e-a8c5-6739d5f8bcea): created successfully Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5701d79-6efc-4466-af1f-ef7219ba1a4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Flow 'volume_create_manager' (174ca9ba-2f33-474d-bab7-52e2e9a31eb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:38:44 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-79b1f951-ac46-42a1-b803-ecd8d5b16a32 tempest-AttachVolumeShelveTestJSON-755120154 None] Created volume successfully. Sep 29 18:38:44 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3" returned: 0 in 0.416s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-10571a25-5523-450f-9b70-0dbf1ee88cfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0fb4ce9-b413-4563-8bca-871573d172c7]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:44 devstack sudo[92454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc Sep 29 18:38:44 devstack sudo[92454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:45 devstack sudo[92454]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc" returned: 0 in 0.351s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:45 devstack sudo[92459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 Sep 29 18:38:45 devstack sudo[92459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:45 devstack sudo[92459]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3" returned: 0 in 0.459s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:45 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3 Sep 29 18:38:45 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:45 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc.4a3e3b36-2259-4fa9-8c12-e2962f55daa3" returned: 0 in 0.308s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "cinder-quobyte-4a3e3b36-2259-4fa9-8c12-e2962f55daa3" released by "_delete_snapshot" :: held 1.691s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "cinder-quobyte-10571a25-5523-450f-9b70-0dbf1ee88cfc" released by "delete_snapshot" :: held 1.730s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:45 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Created reservations ['a737befb-5d6e-4281-a7fe-bfb6e611ce3a', 'e2c2b426-f3bb-4536-855e-c1f714166912', 'fefd4bff-66f8-4278-90d9-45e5b4137b90', '4b8e9fdd-23f3-458d-8d36-9481599a798f'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:46 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Delete snapshot completed successfully. Sep 29 18:38:46 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-697a5161-0c81-455e-ac6c-b0d06a782a88 tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "cinder-4a3e3b36-2259-4fa9-8c12-e2962f55daa3-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:46 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Acquiring lock "cinder-10571a25-5523-450f-9b70-0dbf1ee88cfc-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:46 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "cinder-10571a25-5523-450f-9b70-0dbf1ee88cfc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:46 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Acquiring lock "cinder-quobyte-10571a25-5523-450f-9b70-0dbf1ee88cfc" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:38:46 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "cinder-quobyte-10571a25-5523-450f-9b70-0dbf1ee88cfc" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:38:46 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf26c5a5-123e-4e04-b511-b1c22046dd15]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:38:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:46 devstack sudo[92507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc Sep 29 18:38:46 devstack sudo[92507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:47 devstack sudo[92507]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc" returned: 0 in 0.513s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:47 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc Sep 29 18:38:47 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:47 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-10571a25-5523-450f-9b70-0dbf1ee88cfc" returned: 0 in 0.366s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "cinder-quobyte-10571a25-5523-450f-9b70-0dbf1ee88cfc" released by "delete_volume" :: held 0.990s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:47 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Created reservations ['d8b0cbb4-e039-4330-a9b5-9e6ea511d26f', 'b90e05d4-0fda-4c3a-b467-e091747b18e8', '793b3c3a-78f7-4c1f-828a-23a21e1a988a', '11803abc-a247-4b51-af69-e6a50a196868'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:38:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:47 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:38:47 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:47 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.298s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:47 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:47 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Deleted volume successfully. Sep 29 18:38:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a615c658-95f7-4507-93c1-9c1122b09c7f tempest-VolumeSnapshotQuotasNegativeTestJSON-295036453 None] Lock "cinder-10571a25-5523-450f-9b70-0dbf1ee88cfc-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:38:57 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=48,cinder:UPDATE=63,cinder:INSERT=15,cinder:DELETE=3 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:38:57 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=57,cinder:UPDATE=46,cinder:DELETE=6,cinder:INSERT=10 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:38:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:38:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:38:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:38:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:38:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:38:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:38:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:38:58 devstack sudo[92559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:38:58 devstack sudo[92559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:38:58 devstack sudo[92559]: pam_unix(sudo:session): session closed for user root Sep 29 18:38:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.316s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:38:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:38:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:38:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:38:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:39:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-0ef10bb4-5e08-4bf8-83e0-0c912fbda531 req-d167acf4-7b97-4d4b-a9be-e41651145fd8 tempest-AttachVolumeShelveTestJSON-755120154 None] No connector for attachment 8a2e3214-9a97-4093-9b21-fa9d06139411; skipping storage backend terminate_connection call. {{(pid=86523) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5050}} Sep 29 18:39:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-0ef10bb4-5e08-4bf8-83e0-0c912fbda531 req-d167acf4-7b97-4d4b-a9be-e41651145fd8 tempest-AttachVolumeShelveTestJSON-755120154 None] Deleting attachment 8a2e3214-9a97-4093-9b21-fa9d06139411. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Flow 'volume_create_manager' (95cee5e1-df4f-457a-babf-696f84c84445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b48144b-3b5a-40ee-869f-20e9ffb2814d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b48144b-3b5a-40ee-869f-20e9ffb2814d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-933640712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bd463f-26ed-4933-b85c-caeda750028c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b232fbdba1492a9da300b098539108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:06Z,use_quota=True,user_id='60333b665dc34184b09aef837e1ed150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254b1e84-34ac-4bae-b496-8f6db3832dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254b1e84-34ac-4bae-b496-8f6db3832dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8599614b-7361-416f-a54d-872c2eb95748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8599614b-7361-416f-a54d-872c2eb95748) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '63bd463f-26ed-4933-b85c-caeda750028c', 'volume_name': 'volume-63bd463f-26ed-4933-b85c-caeda750028c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87dc9002-0007-4ca1-8800-f50f401bf24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87dc9002-0007-4ca1-8800-f50f401bf24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5570b3d-a1ac-488d-aa05-e616d292510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:06 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Volume 63bd463f-26ed-4933-b85c-caeda750028c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-63bd463f-26ed-4933-b85c-caeda750028c', 'volume_size': 1} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-933640712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=63bd463f-26ed-4933-b85c-caeda750028c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67b232fbdba1492a9da300b098539108',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:06Z,use_quota=True,user_id='60333b665dc34184b09aef837e1ed150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Creating volume 63bd463f-26ed-4933-b85c-caeda750028c {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:06 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:39:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-63bd463f-26ed-4933-b85c-caeda750028c 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:06 devstack sudo[92663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-63bd463f-26ed-4933-b85c-caeda750028c 1073741824 Sep 29 18:39:06 devstack sudo[92663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:07 devstack sudo[92663]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-63bd463f-26ed-4933-b85c-caeda750028c 1073741824" returned: 0 in 0.708s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-63bd463f-26ed-4933-b85c-caeda750028c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:07 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-63bd463f-26ed-4933-b85c-caeda750028c Sep 29 18:39:07 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:07 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-63bd463f-26ed-4933-b85c-caeda750028c" returned: 0 in 0.405s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:39:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5570b3d-a1ac-488d-aa05-e616d292510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-63bd463f-26ed-4933-b85c-caeda750028c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3c0a30-33e9-44ae-90e1-bbc0f7cf12af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:07 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Volume volume-63bd463f-26ed-4933-b85c-caeda750028c (63bd463f-26ed-4933-b85c-caeda750028c): created successfully Sep 29 18:39:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f3c0a30-33e9-44ae-90e1-bbc0f7cf12af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Flow 'volume_create_manager' (95cee5e1-df4f-457a-babf-696f84c84445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:07 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-635d50b9-86e3-4ace-b881-babc8ddd109e tempest-AbsoluteLimitsTests-376941793 None] Created volume successfully. Sep 29 18:39:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Acquiring lock "cinder-63bd463f-26ed-4933-b85c-caeda750028c-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Lock "cinder-63bd463f-26ed-4933-b85c-caeda750028c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Acquiring lock "cinder-quobyte-63bd463f-26ed-4933-b85c-caeda750028c" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Lock "cinder-quobyte-63bd463f-26ed-4933-b85c-caeda750028c" acquired by "delete_volume" :: waited 0.063s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:09 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[db742f5a-90e3-4967-bde0-12f01c6e47ec]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-63bd463f-26ed-4933-b85c-caeda750028c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:09 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-63bd463f-26ed-4933-b85c-caeda750028c Sep 29 18:39:09 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:10 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-63bd463f-26ed-4933-b85c-caeda750028c" returned: 0 in 1.097s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-63bd463f-26ed-4933-b85c-caeda750028c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:10 devstack sudo[92776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-63bd463f-26ed-4933-b85c-caeda750028c Sep 29 18:39:10 devstack sudo[92776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:10 devstack sudo[92776]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-63bd463f-26ed-4933-b85c-caeda750028c" returned: 0 in 0.449s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:10 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Lock "cinder-quobyte-63bd463f-26ed-4933-b85c-caeda750028c" released by "delete_volume" :: held 1.702s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:10 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Created reservations ['2eab98ef-1e85-4e85-887f-70194b9d7c6e', 'e2aebc50-9734-4c39-b228-8522739bdeb1', '6a2ced15-f47e-45c9-934f-921a00355734', '05818e9e-97ed-4847-8eba-fe32271f4501'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:11 devstack sudo[92779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:39:11 devstack sudo[92779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:11 devstack sudo[92779]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.354s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:11 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:11 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Deleted volume successfully. Sep 29 18:39:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-703d02cc-7f41-4774-b55f-c25bb7b29864 tempest-AbsoluteLimitsTests-376941793 None] Lock "cinder-63bd463f-26ed-4933-b85c-caeda750028c-delete_volume" released by "delete_volume" :: held 2.622s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:20 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=10,cinder:UPDATE=14,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Flow 'volume_create_manager' (7c2157db-369f-4586-9f8c-259d95d239a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241b8cc4-b3a8-4d4d-8646-1f41bf3a4df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241b8cc4-b3a8-4d4d-8646-1f41bf3a4df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2052728560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01dc4d7fbd47328900fd645c3466e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:22Z,use_quota=True,user_id='2a594422fffe4c2881e809772c91a5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b00aca-cd9a-4e82-a089-96e2b4f86b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35b00aca-cd9a-4e82-a089-96e2b4f86b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd18f7f-ddac-4613-a18c-82be8f452276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd18f7f-ddac-4613-a18c-82be8f452276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2', 'volume_name': 'volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d7e1b2-ee61-4f52-8e5c-8023fd4b5f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07d7e1b2-ee61-4f52-8e5c-8023fd4b5f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef829ca5-4425-4e29-bb20-50ae92087428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:21 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Volume dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2', 'volume_size': 1} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2052728560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01dc4d7fbd47328900fd645c3466e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:22Z,use_quota=True,user_id='2a594422fffe4c2881e809772c91a5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Creating volume dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:21 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:39:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:21 devstack sudo[92960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 1073741824 Sep 29 18:39:21 devstack sudo[92960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:22 devstack sudo[92960]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 1073741824" returned: 0 in 0.884s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:22 devstack sudo[92968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 Sep 29 18:39:22 devstack sudo[92968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:23 devstack sudo[92968]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" returned: 0 in 0.393s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] <== create_volume: return (1367ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:39:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.373s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef829ca5-4425-4e29-bb20-50ae92087428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ee5edc-7e05-401b-9892-84f98389fb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:23 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Volume volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 (dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2): created successfully Sep 29 18:39:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49ee5edc-7e05-401b-9892-84f98389fb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Flow 'volume_create_manager' (7c2157db-369f-4586-9f8c-259d95d239a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:23 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-470b4203-8cd6-4b0f-a98b-15ca014f021b tempest-VolumesDeleteCascade-118824195 None] Created volume successfully. Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Flow 'volume_create_manager' (cb31f6ab-da47-4151-9c2b-3d661f3268bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fc77f1-7dc3-4020-b325-64dda2d0e0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] Creating offline snapshot 86454b39-8376-4e37-8c9e-94fd4ea6bae5 of volume dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93fc77f1-7dc3-4020-b325-64dda2d0e0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-97665685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827388aaaffb4a4eb2d6c533de3d4811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:24Z,use_quota=True,user_id='8d4c01730c784ed6990f45d620e2c430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9a3029-88ff-4feb-8b45-a04492068a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb9a3029-88ff-4feb-8b45-a04492068a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b3a4a2-e50f-461d-9c71-e88203ca5254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b3a4a2-e50f-461d-9c71-e88203ca5254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48', 'volume_name': 'volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf38eca-51c7-4017-be43-aa268314cd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddf38eca-51c7-4017-be43-aa268314cd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2c0f55-af61-495d-a7e2-2809b5356c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:24 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Volume da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48', 'volume_size': 1} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[438abd74-e1c2-4be0-a0b3-0b3a3bc487f5]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:24 devstack sudo[93005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 Sep 29 18:39:24 devstack sudo[93005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:24 devstack sudo[93005]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" returned: 0 in 0.403s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:24 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 1G Sep 29 18:39:24 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:25 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 1G" returned: 0 in 0.491s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:25 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 Sep 29 18:39:25 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:25 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5" returned: 0 in 0.306s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:25 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 is being set with open permissions: ugo+rw Sep 29 18:39:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:25 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 Sep 29 18:39:25 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:25 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5" returned: 0 in 0.286s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:26 devstack sudo[93028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.info Sep 29 18:39:26 devstack sudo[93028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:26 devstack sudo[93028]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.info" returned: 0 in 0.301s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:26 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.info is being set with open permissions: ugo+rw Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:26 devstack sudo[93031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.info Sep 29 18:39:26 devstack sudo[93031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:26 devstack sudo[93031]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.info" returned: 0 in 0.267s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.247s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.137s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-97665685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='827388aaaffb4a4eb2d6c533de3d4811',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:24Z,use_quota=True,user_id='8d4c01730c784ed6990f45d620e2c430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Creating volume da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:26 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:39:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:26 devstack sudo[93034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48 1073741824 Sep 29 18:39:26 devstack sudo[93034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:26 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f03028be-ad88-451e-98c0-0e26b05d5876 tempest-VolumesDeleteCascade-118824195 None] Create snapshot completed successfully Sep 29 18:39:27 devstack sudo[93034]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48 1073741824" returned: 0 in 0.450s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:27 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48 Sep 29 18:39:27 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:27 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48" returned: 0 in 0.355s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b2c0f55-af61-495d-a7e2-2809b5356c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b7bfee-8108-4a03-bb26-7bfd209abc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:27 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Volume volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48 (da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48): created successfully Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b7bfee-8108-4a03-bb26-7bfd209abc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Flow 'volume_create_manager' (cb31f6ab-da47-4151-9c2b-3d661f3268bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f90fd340-e413-4058-8c98-38a1cde23e7f tempest-ServerRescueNegativeTestJSON-224476591 None] Created volume successfully. Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] Creating offline snapshot 8a90ca24-ada3-4a1e-af01-c758c47a7b0b of volume dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3e3d18-5101-4d47-9e01-deaf8e35cbf7]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:27 devstack sudo[93042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 Sep 29 18:39:27 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:28 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5" returned: 0 in 0.401s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:28 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b 1G Sep 29 18:39:28 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:28 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b 1G" returned: 0 in 0.704s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:28 devstack sudo[93054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b Sep 29 18:39:28 devstack sudo[93054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:29 devstack sudo[93054]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b" returned: 0 in 0.459s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:29 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b is being set with open permissions: ugo+rw Sep 29 18:39:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:29 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b Sep 29 18:39:29 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:29 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b" returned: 0 in 0.343s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:29 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-0a52a428-218c-4310-84b9-5e1ff00cc3c5 tempest-VolumesDeleteCascade-118824195 None] Create snapshot completed successfully Sep 29 18:39:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Performing cascade delete. {{(pid=86523) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Sep 29 18:39:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-86454b39-8376-4e37-8c9e-94fd4ea6bae5-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-86454b39-8376-4e37-8c9e-94fd4ea6bae5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-quobyte-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-quobyte-86454b39-8376-4e37-8c9e-94fd4ea6bae5" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-86454b39-8376-4e37-8c9e-94fd4ea6bae5" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Deleting offline snapshot 86454b39-8376-4e37-8c9e-94fd4ea6bae5 of volume dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:39:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] snapshot_file for this snap is: volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:39:30 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc9b27d-4ef4-48fe-82f5-f0d2fd926171]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:30 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 Sep 29 18:39:30 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:31 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5" returned: 0 in 0.639s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:31 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1891bfe-b148-432b-86d9-572455eca68d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:31 devstack sudo[93085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 Sep 29 18:39:31 devstack sudo[93085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:31 devstack sudo[93085]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" returned: 0 in 0.554s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:31 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db0f388-f009-4950-8e1a-aff38e5ab1f5]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:32 devstack sudo[93097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b Sep 29 18:39:32 devstack sudo[93097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:32 devstack sudo[93097]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b" returned: 0 in 0.645s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:32 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[db16af57-a1c2-4eb8-a287-cf91bcaa5ac4]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:32 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 Sep 29 18:39:32 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:32 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5" returned: 0 in 0.421s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:32 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c15e014-3bde-4aec-a9b4-f859e26729c7]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:33 devstack sudo[93139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 Sep 29 18:39:33 devstack sudo[93139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:33 devstack sudo[93139]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" returned: 0 in 0.600s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:33 devstack sudo[93144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 Sep 29 18:39:33 devstack sudo[93144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:34 devstack sudo[93144]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5" returned: 0 in 0.577s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:34 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5 Sep 29 18:39:34 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:34 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.86454b39-8376-4e37-8c9e-94fd4ea6bae5" returned: 0 in 0.259s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b -F qcow2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:34 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b -F qcow2 Sep 29 18:39:34 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:34 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b -F qcow2" returned: 0 in 0.531s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-86454b39-8376-4e37-8c9e-94fd4ea6bae5" released by "_delete_snapshot" :: held 4.560s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" released by "delete_snapshot" :: held 4.631s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:35 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Created reservations ['e1207666-1493-4964-bd72-27a77beaa9eb', '4f7d9bf0-9ccb-4e25-b966-6ed02c83b417', '89c58eaf-3911-4336-a826-e53150dab687', '65cf3472-b2cb-4c70-b135-37fe85cf3c51'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:35 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Delete snapshot completed successfully. Sep 29 18:39:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-86454b39-8376-4e37-8c9e-94fd4ea6bae5-delete_snapshot" released by "delete_snapshot" :: held 4.971s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-8a90ca24-ada3-4a1e-af01-c758c47a7b0b-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-8a90ca24-ada3-4a1e-af01-c758c47a7b0b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-quobyte-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-quobyte-8a90ca24-ada3-4a1e-af01-c758c47a7b0b" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-8a90ca24-ada3-4a1e-af01-c758c47a7b0b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Deleting offline snapshot 8a90ca24-ada3-4a1e-af01-c758c47a7b0b of volume dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:39:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] snapshot_file for this snap is: volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:39:35 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ce106a-b939-495f-81db-277fcef4eb82]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:35 devstack sudo[93161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b Sep 29 18:39:35 devstack sudo[93161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:36 devstack sudo[93161]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b" returned: 0 in 0.942s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:36 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[283e7b4c-66e1-445e-bc00-c3f16d68f50b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:36 devstack sudo[93167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 Sep 29 18:39:36 devstack sudo[93167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:37 devstack sudo[93167]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" returned: 0 in 0.645s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:37 devstack sudo[93174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b Sep 29 18:39:37 devstack sudo[93174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:37 devstack sudo[93174]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b" returned: 0 in 0.452s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:37 devstack sudo[93192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b Sep 29 18:39:37 devstack sudo[93192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:38 devstack sudo[93192]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2.8a90ca24-ada3-4a1e-af01-c758c47a7b0b" returned: 0 in 0.489s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-8a90ca24-ada3-4a1e-af01-c758c47a7b0b" released by "_delete_snapshot" :: held 2.744s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" released by "delete_snapshot" :: held 2.781s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:38 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Created reservations ['54c989e5-526e-4194-a6c5-23ed36993a97', '30c46443-d252-4f78-b21a-2ed530cffdb4', 'f1ba88e0-2097-4fb1-9cbf-553d1916d651', '631c1810-aec2-47fb-a2af-7f4b3ab02e95'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:38 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Delete snapshot completed successfully. Sep 29 18:39:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-8a90ca24-ada3-4a1e-af01-c758c47a7b0b-delete_snapshot" released by "delete_snapshot" :: held 3.009s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Snapshots deleted, issuing volume delete {{(pid=86523) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Sep 29 18:39:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-quobyte-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" acquired by "delete_volume" :: waited 0.013s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:38 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3776fa-d289-4f14-bb13-a76ce14748dc]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:38 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 Sep 29 18:39:38 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:38 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" returned: 0 in 0.488s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:38 devstack sudo[93230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2 Sep 29 18:39:38 devstack sudo[93230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:39 devstack sudo[93230]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" returned: 0 in 0.312s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2" released by "delete_volume" :: held 0.865s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:39 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Created reservations ['6838eb0d-396a-4fa2-a155-ba8a74f9db89', 'e7d9906a-adff-47e9-b3a4-22deeb912d1c', '76a98a86-84cb-406f-858b-3893dfe5cd94', 'd967e05c-fcf6-481a-b535-c2fd6b94a4d9'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:39 devstack sudo[93235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:39:39 devstack sudo[93235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:39 devstack sudo[93235]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.329s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:39 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:39 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Deleted volume successfully. Sep 29 18:39:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-11436447-2d1b-4677-a3b9-bd122c218cbf tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-dc4e1537-0edf-430a-8fc9-5e61d6e1e1d2-delete_volume" released by "delete_volume" :: held 9.746s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Flow 'volume_create_manager' (2da85ef3-d892-4d14-bcb4-1b0878084e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d789cd-ff6f-4133-a04a-f1f2dd32e4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d789cd-ff6f-4133-a04a-f1f2dd32e4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1724674656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0548b1cf-85ea-4b84-a3f3-86f71d16b7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01dc4d7fbd47328900fd645c3466e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:41Z,use_quota=True,user_id='2a594422fffe4c2881e809772c91a5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4df7cb2-4962-4136-b2ed-9bf60cd25425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4df7cb2-4962-4136-b2ed-9bf60cd25425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62a2b2b-49be-400b-8a2b-2c905e67692e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62a2b2b-49be-400b-8a2b-2c905e67692e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0548b1cf-85ea-4b84-a3f3-86f71d16b7f2', 'volume_name': 'volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20e3aed-106b-41b8-9616-e591a7d76be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e20e3aed-106b-41b8-9616-e591a7d76be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b842b3-b78a-464d-a7b9-b0f225bcde61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:41 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Volume 0548b1cf-85ea-4b84-a3f3-86f71d16b7f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2', 'volume_size': 1} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1724674656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0548b1cf-85ea-4b84-a3f3-86f71d16b7f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01dc4d7fbd47328900fd645c3466e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:41Z,use_quota=True,user_id='2a594422fffe4c2881e809772c91a5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Creating volume 0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:41 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:41 devstack sudo[93270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 1073741824 Sep 29 18:39:41 devstack sudo[93270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:41 devstack sudo[93270]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 1073741824" returned: 0 in 0.526s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:41 devstack sudo[93276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 Sep 29 18:39:41 devstack sudo[93276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Acquiring lock "cinder-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Lock "cinder-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Acquiring lock "cinder-quobyte-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Lock "cinder-quobyte-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b5d3ad-7c37-4115-8379-be8ef471fb52]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:42 devstack sudo[93276]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2" returned: 0 in 0.356s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35b842b3-b78a-464d-a7b9-b0f225bcde61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543ccaae-a27e-4dfe-bbe7-a24effa7638c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:42 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Volume volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 (0548b1cf-85ea-4b84-a3f3-86f71d16b7f2): created successfully Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (543ccaae-a27e-4dfe-bbe7-a24effa7638c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Flow 'volume_create_manager' (2da85ef3-d892-4d14-bcb4-1b0878084e96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:42 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ae79bc59-05a0-4c80-b531-688e3f78b660 tempest-VolumesDeleteCascade-118824195 None] Created volume successfully. Sep 29 18:39:42 devstack sudo[93279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48 Sep 29 18:39:42 devstack sudo[93279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:42 devstack sudo[93279]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48" returned: 0 in 0.457s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:42 devstack sudo[93284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48 Sep 29 18:39:42 devstack sudo[93284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:42 devstack sudo[93284]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48" returned: 0 in 0.248s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Lock "cinder-quobyte-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48" released by "delete_volume" :: held 0.789s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Created reservations ['7d630100-8e36-4b3c-b4e9-548e76476450', '3524deca-c78c-4740-b82f-23b5674161d0', '7e0667e2-0e95-4179-acc8-cb4ec10b76db', '65f10b72-5352-4f0e-9e28-716c5fd28431'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:42 devstack sudo[93288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:39:42 devstack sudo[93288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:43 devstack sudo[93288]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.321s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:43 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:43 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Deleted volume successfully. Sep 29 18:39:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3703e087-24fa-4788-b852-406867bde063 tempest-ServerRescueNegativeTestJSON-224476591 None] Lock "cinder-da5cd6cc-6aa2-4c67-a351-1cbc03c6fc48-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] Creating offline snapshot 5b755f66-4e4b-4688-a19f-f9d7a6e1b779 of volume 0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:39:43 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4c8ae8d-489f-41ff-94ad-bd169a3801cd]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:43 devstack sudo[93296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 Sep 29 18:39:43 devstack sudo[93296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:44 devstack sudo[93296]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2" returned: 0 in 0.700s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:44 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 1G Sep 29 18:39:44 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:44 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 1G" returned: 0 in 0.639s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:45 devstack sudo[93339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 Sep 29 18:39:45 devstack sudo[93339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:45 devstack sudo[93339]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779" returned: 0 in 0.600s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:45 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 is being set with open permissions: ugo+rw Sep 29 18:39:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:45 devstack sudo[93352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 Sep 29 18:39:45 devstack sudo[93352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:45 devstack sudo[93352]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779" returned: 0 in 0.348s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:45 devstack sudo[93395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.info Sep 29 18:39:45 devstack sudo[93395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:46 devstack sudo[93395]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.info" returned: 0 in 0.389s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:46 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.info is being set with open permissions: ugo+rw Sep 29 18:39:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:46 devstack sudo[93400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.info Sep 29 18:39:46 devstack sudo[93400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:46 devstack sudo[93400]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.info" returned: 0 in 0.436s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.276s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:46 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-efe13ec0-50cc-4ed6-9f27-f0edbe48d8cf tempest-VolumesDeleteCascade-118824195 None] Create snapshot completed successfully Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Flow 'volume_create_manager' (6dc14948-d4d4-4fae-b56b-bec8cca0b06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2946602-6033-4273-b172-3c1f843b51ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2946602-6033-4273-b172-3c1f843b51ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:39:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1524741548',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbb73583-ede6-406d-b23c-6351d69dd9cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f01dc4d7fbd47328900fd645c3466e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:39:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5b755f66-4e4b-4688-a19f-f9d7a6e1b779,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:39:49Z,use_quota=True,user_id='2a594422fffe4c2881e809772c91a5fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef918fbd-85e8-4df7-9d4c-c193f9aa5f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef918fbd-85e8-4df7-9d4c-c193f9aa5f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74871f79-176b-41bc-9ffb-fc87247647fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74871f79-176b-41bc-9ffb-fc87247647fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bbb73583-ede6-406d-b23c-6351d69dd9cb', 'volume_name': 'volume-bbb73583-ede6-406d-b23c-6351d69dd9cb', 'volume_size': 1, 'snapshot_id': '5b755f66-4e4b-4688-a19f-f9d7a6e1b779'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4240dff1-047e-431d-84a1-a145c8a88271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4240dff1-047e-431d-84a1-a145c8a88271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d08be7-15a1-462e-a3ee-53acee3da89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:48 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Volume bbb73583-ede6-406d-b23c-6351d69dd9cb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bbb73583-ede6-406d-b23c-6351d69dd9cb', 'volume_size': 1, 'snapshot_id': '5b755f66-4e4b-4688-a19f-f9d7a6e1b779'} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-quobyte-5b755f66-4e4b-4688-a19f-f9d7a6e1b779-bbb73583-ede6-406d-b23c-6351d69dd9cb" by "_create_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-5b755f66-4e4b-4688-a19f-f9d7a6e1b779-bbb73583-ede6-406d-b23c-6351d69dd9cb" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Creating volume bbb73583-ede6-406d-b23c-6351d69dd9cb from snapshot 5b755f66-4e4b-4688-a19f-f9d7a6e1b779 {{(pid=86523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-quobyte-bbb73583-ede6-406d-b23c-6351d69dd9cb" by "_copy_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-bbb73583-ede6-406d-b23c-6351d69dd9cb" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] snapshot: 5b755f66-4e4b-4688-a19f-f9d7a6e1b779, volume: bbb73583-ede6-406d-b23c-6351d69dd9cb, {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9045188-807a-4f95-9fac-2f292288b0f1]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:49 devstack sudo[93427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 Sep 29 18:39:49 devstack sudo[93427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:49 devstack sudo[93427]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779" returned: 0 in 0.471s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:49 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a210c764-f453-4a94-a9bf-14d241a786f3]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:49 devstack sudo[93433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 Sep 29 18:39:49 devstack sudo[93433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:49 devstack sudo[93433]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2" returned: 0 in 0.508s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:39:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Creating direct copy from snapshot {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:39:49 devstack cinder-volume[86523]: DEBUG cinder.utils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Path /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb not found in is_blk_device check {{(pid=86523) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:39:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:49 devstack sudo[93441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb Sep 29 18:39:49 devstack sudo[93441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:56 devstack sudo[93441]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb" returned: 0 in 6.759s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:56 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2, size 1024.00 MB, duration 6.76 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:39:56 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Converted 1024.00 MB image at 151.47 MB/s Sep 29 18:39:56 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb is being set with open permissions: ugo+rw Sep 29 18:39:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:56 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb Sep 29 18:39:56 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:56 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb" returned: 0 in 0.264s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-bbb73583-ede6-406d-b23c-6351d69dd9cb" released by "_copy_volume_from_snapshot" :: held 8.125s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-5b755f66-4e4b-4688-a19f-f9d7a6e1b779-bbb73583-ede6-406d-b23c-6351d69dd9cb" released by "_create_volume_from_snapshot" :: held 8.229s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.261s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77d08be7-15a1-462e-a3ee-53acee3da89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbb73583-ede6-406d-b23c-6351d69dd9cb', 'volume_size': 1, 'snapshot_id': '5b755f66-4e4b-4688-a19f-f9d7a6e1b779'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c38b2c-8503-41b7-83d5-cafdeaba7be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:39:57 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Volume volume-bbb73583-ede6-406d-b23c-6351d69dd9cb (bbb73583-ede6-406d-b23c-6351d69dd9cb): created successfully Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4c38b2c-8503-41b7-83d5-cafdeaba7be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Flow 'volume_create_manager' (6dc14948-d4d4-4fae-b56b-bec8cca0b06d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:39:57 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-fa6a8901-f12d-45ad-8941-ab6824edffbc tempest-VolumesDeleteCascade-118824195 None] Created volume successfully. Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Performing cascade delete. {{(pid=86523) delete_volume /opt/stack/cinder/cinder/volume/manager.py:996}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-5b755f66-4e4b-4688-a19f-f9d7a6e1b779-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-5b755f66-4e4b-4688-a19f-f9d7a6e1b779-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-quobyte-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-quobyte-5b755f66-4e4b-4688-a19f-f9d7a6e1b779" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-5b755f66-4e4b-4688-a19f-f9d7a6e1b779" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Deleting offline snapshot 5b755f66-4e4b-4688-a19f-f9d7a6e1b779 of volume 0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] snapshot_file for this snap is: volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[225b205d-ab87-4104-9646-a6380d99e5c0]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:57 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 Sep 29 18:39:57 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:58 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779" returned: 0 in 0.370s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b595b2af-d591-40e1-b674-7d219ccd4918]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:58 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 Sep 29 18:39:58 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:58 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:39:58 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:58 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2" returned: 0 in 0.601s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:58 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 Sep 29 18:39:58 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:58 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.293s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:39:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:39:59 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779" returned: 0 in 0.363s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:59 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779 Sep 29 18:39:59 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:59 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2.5b755f66-4e4b-4688-a19f-f9d7a6e1b779" returned: 0 in 0.255s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-5b755f66-4e4b-4688-a19f-f9d7a6e1b779" released by "_delete_snapshot" :: held 1.690s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2" released by "delete_snapshot" :: held 1.711s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Created reservations ['963ff61f-30a8-4196-afdd-1f16ca6d5992', 'f3947e7d-5b94-4588-8725-ce298de8cf1e', '5379f2b3-7ca4-42bf-b1ae-eb86ac577f07', '432a1225-fe4c-4b58-801f-884c5e057e37'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:39:59 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Delete snapshot completed successfully. Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-5b755f66-4e4b-4688-a19f-f9d7a6e1b779-delete_snapshot" released by "delete_snapshot" :: held 1.865s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Snapshots deleted, issuing volume delete {{(pid=86523) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1011}} Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-quobyte-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb84f9c-d3d2-40d4-9450-7e13f26f8698]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:59 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 Sep 29 18:39:59 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:39:59 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2" returned: 0 in 0.404s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:39:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:39:59 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2 Sep 29 18:39:59 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:00 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2" returned: 0 in 0.294s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2" released by "delete_volume" :: held 0.779s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:00 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Created reservations ['d1110b70-1226-4e6a-bea2-35c6959da8a4', '4df979e3-fe52-4c72-be99-20dfc2408f2b', '323e6917-c965-4fdf-9e64-8e9d1a455cdb', 'ba97681c-e6f7-4be1-b982-14c2e2bdce6d'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:40:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:40:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:40:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:00 devstack sudo[93512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:40:00 devstack sudo[93512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:00 devstack sudo[93512]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.332s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:00 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:40:00 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Deleted volume successfully. Sep 29 18:40:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-77f23bca-cec1-441e-bb0b-18586bf9fe9c tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-0548b1cf-85ea-4b84-a3f3-86f71d16b7f2-delete_volume" released by "delete_volume" :: held 3.257s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-bbb73583-ede6-406d-b23c-6351d69dd9cb-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-bbb73583-ede6-406d-b23c-6351d69dd9cb-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "cinder-quobyte-bbb73583-ede6-406d-b23c-6351d69dd9cb" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-bbb73583-ede6-406d-b23c-6351d69dd9cb" acquired by "delete_volume" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:01 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bcc436b-2231-4a5e-935c-853a454632ad]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:40:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:01 devstack sudo[93539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb Sep 29 18:40:01 devstack sudo[93539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:01 devstack sudo[93539]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb" returned: 0 in 0.386s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:01 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb Sep 29 18:40:01 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:02 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbb73583-ede6-406d-b23c-6351d69dd9cb" returned: 0 in 0.301s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-quobyte-bbb73583-ede6-406d-b23c-6351d69dd9cb" released by "delete_volume" :: held 0.752s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:02 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Created reservations ['68c7b0dc-ea19-4c46-bb26-44de4ee18ae4', '8071e8f2-1d89-4c12-9bd6-836f70fb0296', 'ff8db1df-cc77-4d23-b564-2d867b35c2fc', '7b35fe8e-2a84-4000-a5f6-2b9f8073d95f'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:40:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:40:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:40:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:02 devstack sudo[93553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:40:02 devstack sudo[93553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:02 devstack sudo[93553]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.390s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:02 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:40:02 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Deleted volume successfully. Sep 29 18:40:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-04f0f2c7-1492-4c18-87c3-18ef5b7e3c97 tempest-VolumesDeleteCascade-118824195 None] Lock "cinder-bbb73583-ede6-406d-b23c-6351d69dd9cb-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Acquiring lock "cinder-6b9eb495-eace-487e-a8c5-6739d5f8bcea-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Lock "cinder-6b9eb495-eace-487e-a8c5-6739d5f8bcea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Acquiring lock "cinder-quobyte-6b9eb495-eace-487e-a8c5-6739d5f8bcea" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Lock "cinder-quobyte-6b9eb495-eace-487e-a8c5-6739d5f8bcea" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:05 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f7dd891-0f19-4d4f-bbf2-cd47ea0a604b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:40:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:05 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea Sep 29 18:40:05 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:06 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea" returned: 0 in 0.515s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:06 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea Sep 29 18:40:06 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:06 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b9eb495-eace-487e-a8c5-6739d5f8bcea" returned: 0 in 0.338s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Lock "cinder-quobyte-6b9eb495-eace-487e-a8c5-6739d5f8bcea" released by "delete_volume" :: held 0.906s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:06 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Created reservations ['17a1f3f3-92ec-49aa-aa02-3d53f2d15bc8', 'c5cea303-2c0a-443d-babd-5038ce2768ea', '57ad1a22-6d80-4f26-bb2e-3eef3a74fc70', '10ccbb4c-28c1-440b-b594-3f04178b3b8d'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:40:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:40:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:40:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:06 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:40:06 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:07 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.307s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:07 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:40:07 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Deleted volume successfully. Sep 29 18:40:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d036ee91-502a-4d75-9e40-b0717e01ac1f tempest-AttachVolumeShelveTestJSON-755120154 None] Lock "cinder-6b9eb495-eace-487e-a8c5-6739d5f8bcea-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Flow 'volume_create_manager' (dad31789-bfcb-4a21-b4c6-d27e2edce7b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (032c8a6f-d532-4111-a185-51a06afb42bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (032c8a6f-d532-4111-a185-51a06afb42bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1363324581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2524ff-ec3e-4d92-9181-216f8e92c404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaa6e86cf24e6a852533c9a346116a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:40:09Z,use_quota=True,user_id='90640ba8c25e43c19e757fa0bf878f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119f9798-44e2-42cb-8ae4-720a9dc70d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (119f9798-44e2-42cb-8ae4-720a9dc70d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b452fd00-8aa0-4c97-9590-ba588b9283eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b452fd00-8aa0-4c97-9590-ba588b9283eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f2524ff-ec3e-4d92-9181-216f8e92c404', 'volume_name': 'volume-6f2524ff-ec3e-4d92-9181-216f8e92c404', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec7c145-0264-48cf-b076-654c79fad8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec7c145-0264-48cf-b076-654c79fad8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1874310-5a75-4ec8-88b6-6b406b27b0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:08 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Volume 6f2524ff-ec3e-4d92-9181-216f8e92c404: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f2524ff-ec3e-4d92-9181-216f8e92c404', 'volume_size': 1} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1363324581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f2524ff-ec3e-4d92-9181-216f8e92c404,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaa6e86cf24e6a852533c9a346116a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:40:09Z,use_quota=True,user_id='90640ba8c25e43c19e757fa0bf878f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Creating volume 6f2524ff-ec3e-4d92-9181-216f8e92c404 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:40:08 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:40:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6f2524ff-ec3e-4d92-9181-216f8e92c404 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:08 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6f2524ff-ec3e-4d92-9181-216f8e92c404 1073741824 Sep 29 18:40:08 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:09 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6f2524ff-ec3e-4d92-9181-216f8e92c404 1073741824" returned: 0 in 0.523s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6f2524ff-ec3e-4d92-9181-216f8e92c404 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:09 devstack sudo[93581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6f2524ff-ec3e-4d92-9181-216f8e92c404 Sep 29 18:40:09 devstack sudo[93581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:09 devstack sudo[93581]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6f2524ff-ec3e-4d92-9181-216f8e92c404" returned: 0 in 0.300s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:40:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1874310-5a75-4ec8-88b6-6b406b27b0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f2524ff-ec3e-4d92-9181-216f8e92c404', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6ccb26-4285-4803-a5d8-05588a3031ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:09 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Volume volume-6f2524ff-ec3e-4d92-9181-216f8e92c404 (6f2524ff-ec3e-4d92-9181-216f8e92c404): created successfully Sep 29 18:40:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e6ccb26-4285-4803-a5d8-05588a3031ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Flow 'volume_create_manager' (dad31789-bfcb-4a21-b4c6-d27e2edce7b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:40:09 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-de974b97-1f03-4a12-b103-98e1f09d35dc tempest-VolumesTransfersTest-820753202 None] Created volume successfully. Sep 29 18:40:11 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-93aa4c3b-177b-4d7e-a315-0aa1315e4c57 tempest-VolumesTransfersTest-879380888 None] Transfer volume completed successfully. Sep 29 18:40:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Acquiring lock "cinder-6f2524ff-ec3e-4d92-9181-216f8e92c404-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Lock "cinder-6f2524ff-ec3e-4d92-9181-216f8e92c404-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Acquiring lock "cinder-quobyte-6f2524ff-ec3e-4d92-9181-216f8e92c404" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Lock "cinder-quobyte-6f2524ff-ec3e-4d92-9181-216f8e92c404" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:12 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4221b14-256b-4f4e-bf20-edd49f2f8e8b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:40:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6f2524ff-ec3e-4d92-9181-216f8e92c404 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:12 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6f2524ff-ec3e-4d92-9181-216f8e92c404 Sep 29 18:40:12 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:13 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6f2524ff-ec3e-4d92-9181-216f8e92c404" returned: 0 in 0.492s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6f2524ff-ec3e-4d92-9181-216f8e92c404 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:13 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6f2524ff-ec3e-4d92-9181-216f8e92c404 Sep 29 18:40:13 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:13 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6f2524ff-ec3e-4d92-9181-216f8e92c404" returned: 0 in 0.308s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Lock "cinder-quobyte-6f2524ff-ec3e-4d92-9181-216f8e92c404" released by "delete_volume" :: held 0.880s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:13 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Created reservations ['f3a12a8d-c167-4ca0-aa3b-6e6d9eab8bd8', '1595655e-0e61-4a1c-865f-248856ac519d', '61b70df8-695b-4b94-9651-bc2d04e68068', '64819f67-aea1-4be1-a269-ba1f965dd8fc'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:40:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:40:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:40:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:13 devstack sudo[93595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:40:13 devstack sudo[93595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:14 devstack sudo[93595]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.325s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:14 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:40:14 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Deleted volume successfully. Sep 29 18:40:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-799822f6-6021-4fd6-8b54-a5d54195569b tempest-VolumesTransfersTest-1361927433 None] Lock "cinder-6f2524ff-ec3e-4d92-9181-216f8e92c404-delete_volume" released by "delete_volume" :: held 1.587s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Flow 'volume_create_manager' (6059a379-8ae5-48b0-9466-b57a2cdb6e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d028921b-48f7-4ac1-981b-d10e94b1c1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d028921b-48f7-4ac1-981b-d10e94b1c1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1813268012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a9235c-7895-404a-bc76-e4ba6308410e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaa6e86cf24e6a852533c9a346116a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:40:15Z,use_quota=True,user_id='90640ba8c25e43c19e757fa0bf878f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d50bf29-4937-4f9b-8e52-e74f1492c815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d50bf29-4937-4f9b-8e52-e74f1492c815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282ef386-519c-4d37-b7a1-f05ff27f91cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (282ef386-519c-4d37-b7a1-f05ff27f91cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62a9235c-7895-404a-bc76-e4ba6308410e', 'volume_name': 'volume-62a9235c-7895-404a-bc76-e4ba6308410e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242315f4-fd23-4dec-a9cc-8bd7ca9a0b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (242315f4-fd23-4dec-a9cc-8bd7ca9a0b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1846e670-f384-4907-b1dd-bd358627d594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:15 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Volume 62a9235c-7895-404a-bc76-e4ba6308410e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62a9235c-7895-404a-bc76-e4ba6308410e', 'volume_size': 1} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:40:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1813268012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62a9235c-7895-404a-bc76-e4ba6308410e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fdaa6e86cf24e6a852533c9a346116a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:40:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:40:15Z,use_quota=True,user_id='90640ba8c25e43c19e757fa0bf878f84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Creating volume 62a9235c-7895-404a-bc76-e4ba6308410e {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:40:15 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:40:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-62a9235c-7895-404a-bc76-e4ba6308410e 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:15 devstack sudo[93601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-62a9235c-7895-404a-bc76-e4ba6308410e 1073741824 Sep 29 18:40:15 devstack sudo[93601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:16 devstack sudo[93601]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-62a9235c-7895-404a-bc76-e4ba6308410e 1073741824" returned: 0 in 0.571s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-62a9235c-7895-404a-bc76-e4ba6308410e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:16 devstack sudo[93608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-62a9235c-7895-404a-bc76-e4ba6308410e Sep 29 18:40:16 devstack sudo[93608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:16 devstack sudo[93608]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-62a9235c-7895-404a-bc76-e4ba6308410e" returned: 0 in 0.351s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:40:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1846e670-f384-4907-b1dd-bd358627d594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62a9235c-7895-404a-bc76-e4ba6308410e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b3ee7b-01af-48f7-82f9-84b4c7c85a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:16 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Volume volume-62a9235c-7895-404a-bc76-e4ba6308410e (62a9235c-7895-404a-bc76-e4ba6308410e): created successfully Sep 29 18:40:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b3ee7b-01af-48f7-82f9-84b4c7c85a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Flow 'volume_create_manager' (6059a379-8ae5-48b0-9466-b57a2cdb6e90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:40:16 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6aa51cc9-64ee-4814-8496-6afd589e94a8 tempest-VolumesTransfersTest-820753202 None] Created volume successfully. Sep 29 18:40:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Acquiring lock "cinder-62a9235c-7895-404a-bc76-e4ba6308410e-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Lock "cinder-62a9235c-7895-404a-bc76-e4ba6308410e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Acquiring lock "cinder-quobyte-62a9235c-7895-404a-bc76-e4ba6308410e" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Lock "cinder-quobyte-62a9235c-7895-404a-bc76-e4ba6308410e" acquired by "delete_volume" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[625cc0e6-c477-4293-9a26-a0c9f5ac1eb1]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-62a9235c-7895-404a-bc76-e4ba6308410e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:18 devstack sudo[93628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-62a9235c-7895-404a-bc76-e4ba6308410e Sep 29 18:40:18 devstack sudo[93628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:18 devstack sudo[93628]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-62a9235c-7895-404a-bc76-e4ba6308410e" returned: 0 in 0.411s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-62a9235c-7895-404a-bc76-e4ba6308410e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:18 devstack sudo[93633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-62a9235c-7895-404a-bc76-e4ba6308410e Sep 29 18:40:18 devstack sudo[93633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:18 devstack sudo[93633]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-62a9235c-7895-404a-bc76-e4ba6308410e" returned: 0 in 0.292s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Lock "cinder-quobyte-62a9235c-7895-404a-bc76-e4ba6308410e" released by "delete_volume" :: held 0.761s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Created reservations ['e1f04e96-8f22-499e-9d5e-3ec61aa264fe', '01e15685-d00a-4dd7-9912-2e47b952ba79', 'c9b7b141-34c1-4c63-ac58-8e510d417e10', '333fcf5f-e16d-44f6-8b86-1bce494d1684'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:19 devstack sudo[93636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:40:19 devstack sudo[93636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:19 devstack sudo[93636]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.313s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:19 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:40:19 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Deleted volume successfully. Sep 29 18:40:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f1b4a97d-a330-4e38-89bc-264f97927c5f tempest-VolumesTransfersTest-1361927433 None] Lock "cinder-62a9235c-7895-404a-bc76-e4ba6308410e-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:28 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=81,cinder:UPDATE=89,cinder:INSERT=27,cinder:DELETE=8 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:40:29 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=100,cinder:SELECT=68,cinder:DELETE=8,cinder:INSERT=21 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:40:46 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:40:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Flow 'volume_create_manager' (ca203d9c-14c2-4efb-bb3b-b19024474161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:40:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e376a286-9b2b-4467-bc3a-d7a9c3d28495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e376a286-9b2b-4467-bc3a-d7a9c3d28495) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2004620945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e29f85c-d173-4738-893d-fec5097bb2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d32fb33351495bb2a5912a1e43baed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:40:47Z,use_quota=True,user_id='8c2bdd0c191b435a8f665f07a8e5c1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d4c6d2-0101-414d-bc3c-90290c422940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d4c6d2-0101-414d-bc3c-90290c422940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee78aa02-95c8-4e4e-a794-330a84e65db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee78aa02-95c8-4e4e-a794-330a84e65db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e29f85c-d173-4738-893d-fec5097bb2be', 'volume_name': 'volume-9e29f85c-d173-4738-893d-fec5097bb2be', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c03be62-68d6-471f-978e-fda5c1909946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c03be62-68d6-471f-978e-fda5c1909946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8d26ed-eb99-468a-9906-d41fc9b78844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:47 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Volume 9e29f85c-d173-4738-893d-fec5097bb2be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e29f85c-d173-4738-893d-fec5097bb2be', 'volume_size': 1} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2004620945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e29f85c-d173-4738-893d-fec5097bb2be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3d32fb33351495bb2a5912a1e43baed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:40:47Z,use_quota=True,user_id='8c2bdd0c191b435a8f665f07a8e5c1cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Creating volume 9e29f85c-d173-4738-893d-fec5097bb2be {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:40:47 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:40:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:47 devstack sudo[93986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be 1073741824 Sep 29 18:40:47 devstack sudo[93986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:48 devstack sudo[93986]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be 1073741824" returned: 0 in 1.192s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:48 devstack sudo[94018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be Sep 29 18:40:48 devstack sudo[94018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:48 devstack sudo[94018]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be" returned: 0 in 0.398s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] <== create_volume: return (1666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:40:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8d26ed-eb99-468a-9906-d41fc9b78844) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e29f85c-d173-4738-893d-fec5097bb2be', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e175794-62cd-4f8c-a56a-139c4a7371dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:48 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Volume volume-9e29f85c-d173-4738-893d-fec5097bb2be (9e29f85c-d173-4738-893d-fec5097bb2be): created successfully Sep 29 18:40:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e175794-62cd-4f8c-a56a-139c4a7371dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Flow 'volume_create_manager' (ca203d9c-14c2-4efb-bb3b-b19024474161) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:40:48 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8a816d36-01a7-41d0-81bb-b622f033a72d tempest-VolumesActionsTest-311794192 None] Created volume successfully. Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Flow 'volume_create_manager' (305260b5-79ce-494d-8ad3-245d9f8f1299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82abd040-f77a-4242-9d62-8f39e289897f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82abd040-f77a-4242-9d62-8f39e289897f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-525917996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779271af-e132-417b-8051-e3b30a2fabde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2249c9f9743d4747ab9b1a389ebce889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:40:51Z,use_quota=True,user_id='bf87326953464bd5a1a7e051ee615cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06408046-ecd7-445d-9b50-7c7f78b3428a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06408046-ecd7-445d-9b50-7c7f78b3428a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609781e7-170f-4e07-b4c5-a6a9ac99bfb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609781e7-170f-4e07-b4c5-a6a9ac99bfb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '779271af-e132-417b-8051-e3b30a2fabde', 'volume_name': 'volume-779271af-e132-417b-8051-e3b30a2fabde', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a420d7-71f0-4063-8c75-65a7cb92261a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3a420d7-71f0-4063-8c75-65a7cb92261a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e03a463-76ce-4ab2-86a3-04e438e3fe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:50 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Volume 779271af-e132-417b-8051-e3b30a2fabde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-779271af-e132-417b-8051-e3b30a2fabde', 'volume_size': 1} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:40:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-525917996',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779271af-e132-417b-8051-e3b30a2fabde,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2249c9f9743d4747ab9b1a389ebce889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:40:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:40:51Z,use_quota=True,user_id='bf87326953464bd5a1a7e051ee615cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Creating volume 779271af-e132-417b-8051-e3b30a2fabde {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:40:50 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:40:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-779271af-e132-417b-8051-e3b30a2fabde 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:50 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-779271af-e132-417b-8051-e3b30a2fabde 1073741824 Sep 29 18:40:50 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:51 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-779271af-e132-417b-8051-e3b30a2fabde 1073741824" returned: 0 in 0.866s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-779271af-e132-417b-8051-e3b30a2fabde {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:51 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-779271af-e132-417b-8051-e3b30a2fabde Sep 29 18:40:51 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:52 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-779271af-e132-417b-8051-e3b30a2fabde" returned: 0 in 0.311s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:52 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] <== create_volume: return (1241ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:40:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e03a463-76ce-4ab2-86a3-04e438e3fe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779271af-e132-417b-8051-e3b30a2fabde', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f4be69-e235-4552-a4b6-aa6e097e6a4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:52 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Volume volume-779271af-e132-417b-8051-e3b30a2fabde (779271af-e132-417b-8051-e3b30a2fabde): created successfully Sep 29 18:40:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93f4be69-e235-4552-a4b6-aa6e097e6a4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Flow 'volume_create_manager' (305260b5-79ce-494d-8ad3-245d9f8f1299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:40:52 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f2512cf1-8085-4c0f-8896-2f7338cd63b2 tempest-ServersNegativeTestJSON-2141197575 None] Created volume successfully. Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Flow 'volume_create_manager' (11e6af51-4e89-4625-abb3-b5d28a845dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bc0ee0-c35c-455a-8b9c-afbe4871b0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bc0ee0-c35c-455a-8b9c-afbe4871b0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1849936028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db070e6-f626-402a-bbff-e20e22cf2858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2249c9f9743d4747ab9b1a389ebce889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:40:55Z,use_quota=True,user_id='bf87326953464bd5a1a7e051ee615cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b8897f-722e-4d4b-bd45-0dbb70285cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0b8897f-722e-4d4b-bd45-0dbb70285cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e9d08f-3c3f-471c-ad2d-0d082e062c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9e9d08f-3c3f-471c-ad2d-0d082e062c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4db070e6-f626-402a-bbff-e20e22cf2858', 'volume_name': 'volume-4db070e6-f626-402a-bbff-e20e22cf2858', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56a0908-9e42-4ed4-83db-271bdb7169e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f56a0908-9e42-4ed4-83db-271bdb7169e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5acd962-d7d3-409c-9194-7f0fb687d014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:54 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Volume 4db070e6-f626-402a-bbff-e20e22cf2858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4db070e6-f626-402a-bbff-e20e22cf2858', 'volume_size': 1} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1849936028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4db070e6-f626-402a-bbff-e20e22cf2858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2249c9f9743d4747ab9b1a389ebce889',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:40:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:40:55Z,use_quota=True,user_id='bf87326953464bd5a1a7e051ee615cdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Creating volume 4db070e6-f626-402a-bbff-e20e22cf2858 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:40:54 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:40:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4db070e6-f626-402a-bbff-e20e22cf2858 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:54 devstack sudo[94059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4db070e6-f626-402a-bbff-e20e22cf2858 1073741824 Sep 29 18:40:54 devstack sudo[94059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:55 devstack sudo[94059]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4db070e6-f626-402a-bbff-e20e22cf2858 1073741824" returned: 0 in 0.555s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4db070e6-f626-402a-bbff-e20e22cf2858 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:55 devstack sudo[94066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4db070e6-f626-402a-bbff-e20e22cf2858 Sep 29 18:40:55 devstack sudo[94066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:55 devstack sudo[94066]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4db070e6-f626-402a-bbff-e20e22cf2858" returned: 0 in 0.374s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:55 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:40:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:55 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5acd962-d7d3-409c-9194-7f0fb687d014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4db070e6-f626-402a-bbff-e20e22cf2858', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:55 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a645030f-0c92-45c9-8eac-3b7aa2979c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:40:55 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Volume volume-4db070e6-f626-402a-bbff-e20e22cf2858 (4db070e6-f626-402a-bbff-e20e22cf2858): created successfully Sep 29 18:40:55 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a645030f-0c92-45c9-8eac-3b7aa2979c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:40:55 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Flow 'volume_create_manager' (11e6af51-4e89-4625-abb3-b5d28a845dbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:40:55 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-664ee6c7-f4c8-4643-afb9-1242af6d0245 tempest-ServersNegativeTestJSON-2141197575 None] Created volume successfully. Sep 29 18:40:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Acquiring lock "cinder-4db070e6-f626-402a-bbff-e20e22cf2858-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Lock "cinder-4db070e6-f626-402a-bbff-e20e22cf2858-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Acquiring lock "cinder-quobyte-4db070e6-f626-402a-bbff-e20e22cf2858" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Lock "cinder-quobyte-4db070e6-f626-402a-bbff-e20e22cf2858" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bcc92cd-d1e9-492c-97fa-edc2032c321d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4db070e6-f626-402a-bbff-e20e22cf2858 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:58 devstack sudo[94152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4db070e6-f626-402a-bbff-e20e22cf2858 Sep 29 18:40:58 devstack sudo[94152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:58 devstack sudo[94152]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4db070e6-f626-402a-bbff-e20e22cf2858" returned: 0 in 0.459s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4db070e6-f626-402a-bbff-e20e22cf2858 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:40:58 devstack sudo[94157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4db070e6-f626-402a-bbff-e20e22cf2858 Sep 29 18:40:58 devstack sudo[94157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:58 devstack sudo[94159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:40:58 devstack sudo[94159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:58 devstack sudo[94159]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.264s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:40:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:40:59 devstack sudo[94157]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4db070e6-f626-402a-bbff-e20e22cf2858" returned: 0 in 0.492s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Lock "cinder-quobyte-4db070e6-f626-402a-bbff-e20e22cf2858" released by "delete_volume" :: held 1.029s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:40:59 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Created reservations ['c6f0dc67-1097-4f7c-b658-13365e7fb75f', 'ac80b005-ea20-412f-8b3d-d68a451288a3', '08d537f3-dd1b-4831-b377-93063a21e8f1', '57aa3eb3-f458-49fc-a7dc-353e9e021c6b'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:40:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:40:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:40:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:40:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:40:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:40:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:40:59 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:40:59 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:40:59 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Sep 29 18:40:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.277s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:40:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:40:59 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Deleted volume successfully. Sep 29 18:40:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-497377c4-dcfe-4aa5-8c88-f274a795eda7 tempest-ServersNegativeTestJSON-2141197575 None] Lock "cinder-4db070e6-f626-402a-bbff-e20e22cf2858-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:41:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f6a7e03-47d4-4744-a7c8-6fc7c70bac5a tempest-VolumesActionsTest-311794192 None] Acquiring lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be" by "attach_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:41:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Acquiring lock "cinder-779271af-e132-417b-8051-e3b30a2fabde-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:41:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f6a7e03-47d4-4744-a7c8-6fc7c70bac5a tempest-VolumesActionsTest-311794192 None] Lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be" acquired by "attach_volume" :: waited 0.066s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:41:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Lock "cinder-779271af-e132-417b-8051-e3b30a2fabde-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:41:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Acquiring lock "cinder-quobyte-779271af-e132-417b-8051-e3b30a2fabde" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:41:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Lock "cinder-quobyte-779271af-e132-417b-8051-e3b30a2fabde" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:41:00 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2f6a7e03-47d4-4744-a7c8-6fc7c70bac5a tempest-VolumesActionsTest-311794192 None] Attaching volume 9e29f85c-d173-4738-893d-fec5097bb2be to instance d64f5ff1-b7d7-4376-8721-e951f007a3a8 at mountpoint /dev/vdb on host None. Sep 29 18:41:00 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e290c61-1419-4fd9-a72e-b8d966c1eeaf]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:41:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-779271af-e132-417b-8051-e3b30a2fabde {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:00 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2f6a7e03-47d4-4744-a7c8-6fc7c70bac5a tempest-VolumesActionsTest-311794192 None] Attach volume completed successfully. Sep 29 18:41:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f6a7e03-47d4-4744-a7c8-6fc7c70bac5a tempest-VolumesActionsTest-311794192 None] Lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be" released by "attach_volume" :: held 0.241s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:41:00 devstack sudo[94175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-779271af-e132-417b-8051-e3b30a2fabde Sep 29 18:41:00 devstack sudo[94175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-16f909e8-656c-4cf3-b025-f2cee1fff3d8 tempest-VolumesActionsTest-311794192 None] Acquiring lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be-detach_volume" by "detach_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:41:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-16f909e8-656c-4cf3-b025-f2cee1fff3d8 tempest-VolumesActionsTest-311794192 None] Lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be-detach_volume" acquired by "detach_volume" :: waited 0.035s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:41:00 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-16f909e8-656c-4cf3-b025-f2cee1fff3d8 tempest-VolumesActionsTest-311794192 None] Detaching volume 9e29f85c-d173-4738-893d-fec5097bb2be from instance d64f5ff1-b7d7-4376-8721-e951f007a3a8. Sep 29 18:41:00 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-16f909e8-656c-4cf3-b025-f2cee1fff3d8 tempest-VolumesActionsTest-311794192 None] Detach volume completed successfully. Sep 29 18:41:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-16f909e8-656c-4cf3-b025-f2cee1fff3d8 tempest-VolumesActionsTest-311794192 None] Lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be-detach_volume" released by "detach_volume" :: held 0.122s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:41:01 devstack sudo[94175]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-779271af-e132-417b-8051-e3b30a2fabde" returned: 0 in 0.687s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-779271af-e132-417b-8051-e3b30a2fabde {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:01 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-779271af-e132-417b-8051-e3b30a2fabde Sep 29 18:41:01 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:01 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-779271af-e132-417b-8051-e3b30a2fabde" returned: 0 in 0.384s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Lock "cinder-quobyte-779271af-e132-417b-8051-e3b30a2fabde" released by "delete_volume" :: held 1.132s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:41:01 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Created reservations ['b8cc5ddc-0af9-4e99-af2a-e8b1fd3243b5', 'f0c3d2ed-05de-4b48-a5cd-6724d610050e', 'cdb6e888-86eb-4524-8128-c7676d0f171d', 'e53c4b64-a934-4721-aadb-40f9a8f2a0c3'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:41:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:41:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:41:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:41:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:41:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:41:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:01 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:41:01 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:02 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.414s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:02 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:41:02 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Deleted volume successfully. Sep 29 18:41:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-990e82c7-3518-4ef6-bdd3-5d2a0b8bbd61 tempest-ServersNegativeTestJSON-2141197575 None] Lock "cinder-779271af-e132-417b-8051-e3b30a2fabde-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:41:11 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=28,cinder:SELECT=21,cinder:DELETE=1,cinder:INSERT=7 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:41:12 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=25,cinder:UPDATE=29,cinder:INSERT=6,cinder:DELETE=4 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Flow 'volume_create_manager' (8534f20d-5bf7-4d0d-ac56-87453c0b3417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c415120-7fdd-4cb3-ba31-6ffe94262df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c415120-7fdd-4cb3-ba31-6ffe94262df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2306274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08a8b52-407c-4762-ba4f-22ca8cd3b79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c606eb586e8e4aef82c94f12f7ce7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:41:14Z,use_quota=True,user_id='2e9bebf527b74793ad4b1aef9e3759c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031edfea-1554-40dd-ab35-d22036ccb4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (031edfea-1554-40dd-ab35-d22036ccb4de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9473fec-7748-42ea-a089-887bcfa37986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9473fec-7748-42ea-a089-887bcfa37986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a08a8b52-407c-4762-ba4f-22ca8cd3b79b', 'volume_name': 'volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b466b3-3277-4c82-87e7-c1c34f012bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61b466b3-3277-4c82-87e7-c1c34f012bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f99ba8-2b62-4bc1-a898-c8e2957367ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:41:14 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Volume a08a8b52-407c-4762-ba4f-22ca8cd3b79b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b', 'volume_size': 1} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2306274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08a8b52-407c-4762-ba4f-22ca8cd3b79b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c606eb586e8e4aef82c94f12f7ce7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:41:14Z,use_quota=True,user_id='2e9bebf527b74793ad4b1aef9e3759c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Creating volume a08a8b52-407c-4762-ba4f-22ca8cd3b79b {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:41:14 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:14 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b 1073741824 Sep 29 18:41:14 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e723e9ac-3e60-423d-bece-9678b186127a tempest-VolumesActionsTest-311794192 None] Acquiring lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be" by "attach_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e723e9ac-3e60-423d-bece-9678b186127a tempest-VolumesActionsTest-311794192 None] Lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be" acquired by "attach_volume" :: waited 0.035s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:41:14 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e723e9ac-3e60-423d-bece-9678b186127a tempest-VolumesActionsTest-311794192 None] Attaching volume 9e29f85c-d173-4738-893d-fec5097bb2be to instance 213cf9ef-2d2d-4102-af1d-dc457c4c967f at mountpoint /dev/vdb on host None. Sep 29 18:41:14 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e723e9ac-3e60-423d-bece-9678b186127a tempest-VolumesActionsTest-311794192 None] Attach volume completed successfully. Sep 29 18:41:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e723e9ac-3e60-423d-bece-9678b186127a tempest-VolumesActionsTest-311794192 None] Lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be" released by "attach_volume" :: held 0.124s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:41:15 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b 1073741824" returned: 0 in 0.757s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:15 devstack sudo[94372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b Sep 29 18:41:15 devstack sudo[94372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-483dcf64-6279-4759-943e-36c837f3cfef tempest-VolumesActionsTest-311794192 None] Acquiring lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be-detach_volume" by "detach_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:41:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-483dcf64-6279-4759-943e-36c837f3cfef tempest-VolumesActionsTest-311794192 None] Lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:41:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-483dcf64-6279-4759-943e-36c837f3cfef tempest-VolumesActionsTest-311794192 None] Detaching volume 9e29f85c-d173-4738-893d-fec5097bb2be from instance 213cf9ef-2d2d-4102-af1d-dc457c4c967f. Sep 29 18:41:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-483dcf64-6279-4759-943e-36c837f3cfef tempest-VolumesActionsTest-311794192 None] Detach volume completed successfully. Sep 29 18:41:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-483dcf64-6279-4759-943e-36c837f3cfef tempest-VolumesActionsTest-311794192 None] Lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:41:15 devstack sudo[94372]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b" returned: 0 in 0.421s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:41:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:41:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71f99ba8-2b62-4bc1-a898-c8e2957367ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:41:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23fb257-7280-4ea2-966c-d360d102b161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:41:15 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Volume volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b (a08a8b52-407c-4762-ba4f-22ca8cd3b79b): created successfully Sep 29 18:41:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f23fb257-7280-4ea2-966c-d360d102b161) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:41:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Flow 'volume_create_manager' (8534f20d-5bf7-4d0d-ac56-87453c0b3417) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:41:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1133ef03-560f-4e11-bc6c-7a79902ef059 tempest-AttachVolumeNegativeTest-1308614236 None] Created volume successfully. Sep 29 18:41:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-250e6a60-d165-4ac7-b7bd-43a8b092c1e4 req-469343bb-2b73-4192-bf54-3bf358ac5fd2 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:41:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-250e6a60-d165-4ac7-b7bd-43a8b092c1e4 req-469343bb-2b73-4192-bf54-3bf358ac5fd2 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:41:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-250e6a60-d165-4ac7-b7bd-43a8b092c1e4 req-469343bb-2b73-4192-bf54-3bf358ac5fd2 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:41:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-250e6a60-d165-4ac7-b7bd-43a8b092c1e4 req-469343bb-2b73-4192-bf54-3bf358ac5fd2 tempest-AttachVolumeNegativeTest-1308614236 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a3203273-0e3a-467b-ab18-2c579dab21a0', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:41:17 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-250e6a60-d165-4ac7-b7bd-43a8b092c1e4 req-469343bb-2b73-4192-bf54-3bf358ac5fd2 tempest-AttachVolumeNegativeTest-1308614236 None] attachment_update completed successfully. Sep 29 18:41:17 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:41:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Flow 'volume_create_manager' (4b2c886c-a10e-4191-bd18-53e1424a2332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:41:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe978f1-b5c5-403d-8592-b62efc02accf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:41:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbe978f1-b5c5-403d-8592-b62efc02accf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-974351836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea8b958-e309-4c0d-8c45-88e8c510c4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fd7daf8bf540cc8264d4a7f621404c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:41:18Z,use_quota=True,user_id='5bda2c55439048f3b6a4872fdc6eef04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:41:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4128a2-226e-4053-8717-60953679981f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:41:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a4128a2-226e-4053-8717-60953679981f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:41:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d03862-a9fd-4aea-95af-ae9f8c176798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:41:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1d03862-a9fd-4aea-95af-ae9f8c176798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dea8b958-e309-4c0d-8c45-88e8c510c4bd', 'volume_name': 'volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b67282-07c7-49e0-a804-c238dc3f02a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03b67282-07c7-49e0-a804-c238dc3f02a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c411a06-b284-4408-8092-b3e09629a674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:41:18 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Volume dea8b958-e309-4c0d-8c45-88e8c510c4bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd', 'volume_size': 1} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:41:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-974351836',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dea8b958-e309-4c0d-8c45-88e8c510c4bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6fd7daf8bf540cc8264d4a7f621404c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:41:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:41:18Z,use_quota=True,user_id='5bda2c55439048f3b6a4872fdc6eef04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Creating volume dea8b958-e309-4c0d-8c45-88e8c510c4bd {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:41:18 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:18 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd 1073741824 Sep 29 18:41:18 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:18 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd 1073741824" returned: 0 in 0.581s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:18 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd Sep 29 18:41:18 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:18 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd" returned: 0 in 0.328s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:41:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:41:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c411a06-b284-4408-8092-b3e09629a674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:41:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fa8882-c278-40f0-9e10-73a92950cca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:41:19 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Volume volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd (dea8b958-e309-4c0d-8c45-88e8c510c4bd): created successfully Sep 29 18:41:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1fa8882-c278-40f0-9e10-73a92950cca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:41:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Flow 'volume_create_manager' (4b2c886c-a10e-4191-bd18-53e1424a2332) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:41:19 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-f7fcd21b-e667-41df-8639-338372243de5 req-e5e4e572-f7e9-43b3-b8f6-4c02a082a506 tempest-VolumesSnapshotsTestJSON-120352254 None] Created volume successfully. Sep 29 18:41:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:41:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:41:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] Creating offline snapshot a7d380cd-ab61-4db5-b43c-0ca470a8e564 of volume dea8b958-e309-4c0d-8c45-88e8c510c4bd {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:41:20 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0679dae0-ce3b-4315-8a7a-b785709f0fce]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:41:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:20 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd Sep 29 18:41:20 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:20 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd" returned: 0 in 0.447s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:20 devstack sudo[94848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 1G Sep 29 18:41:20 devstack sudo[94848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:41:21 devstack sudo[94848]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 1G" returned: 0 in 0.464s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:21 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 Sep 29 18:41:21 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:21 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564" returned: 0 in 0.315s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:21 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 is being set with open permissions: ugo+rw Sep 29 18:41:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:21 devstack sudo[94859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 Sep 29 18:41:21 devstack sudo[94859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:21 devstack sudo[94859]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564" returned: 0 in 0.280s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:22 devstack sudo[94862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.info Sep 29 18:41:22 devstack sudo[94862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:22 devstack sudo[94862]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.info" returned: 0 in 0.285s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:22 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.info is being set with open permissions: ugo+rw Sep 29 18:41:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:22 devstack sudo[94865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.info Sep 29 18:41:22 devstack sudo[94865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:22 devstack sudo[94865]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.info" returned: 0 in 0.252s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.180s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:41:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.562s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:41:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[176ad050-2a43-4465-9f9e-46cd50e35534]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:41:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:22 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-155f0990-c525-4166-ad4f-78a7a30e59f8 req-9f8f69b3-675f-44e2-b7a6-7281679c205a tempest-VolumesSnapshotsTestJSON-120352254 None] Create snapshot completed successfully Sep 29 18:41:22 devstack sudo[94868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be Sep 29 18:41:22 devstack sudo[94868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Acquiring lock "cinder-a7d380cd-ab61-4db5-b43c-0ca470a8e564-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:41:22 devstack sudo[94868]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be" returned: 0 in 0.411s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "cinder-a7d380cd-ab61-4db5-b43c-0ca470a8e564-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:41:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Acquiring lock "cinder-quobyte-dea8b958-e309-4c0d-8c45-88e8c510c4bd" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:41:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[775bac1c-c1af-44ef-a316-21f68fb780d3]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "cinder-quobyte-dea8b958-e309-4c0d-8c45-88e8c510c4bd" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Acquiring lock "cinder-quobyte-a7d380cd-ab61-4db5-b43c-0ca470a8e564" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "cinder-quobyte-a7d380cd-ab61-4db5-b43c-0ca470a8e564" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Deleting offline snapshot a7d380cd-ab61-4db5-b43c-0ca470a8e564 of volume dea8b958-e309-4c0d-8c45-88e8c510c4bd {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] snapshot_file for this snap is: volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e710eab-0da5-42f1-8494-bf67edad9123]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:23 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be Sep 29 18:41:23 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:23 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 Sep 29 18:41:23 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:23 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be" returned: 0 in 0.493s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.aa8927f1-0600-4a5d-bc77-3f6742dba705pm00mlot.img {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:23 devstack sudo[94885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.aa8927f1-0600-4a5d-bc77-3f6742dba705pm00mlot.img Sep 29 18:41:23 devstack sudo[94885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:23 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564" returned: 0 in 0.476s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ab9586-82da-4379-aef7-446fe6875bdc]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:41:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:23 devstack sudo[94890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd Sep 29 18:41:23 devstack sudo[94890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:24 devstack sudo[94890]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd" returned: 0 in 0.784s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:24 devstack sudo[94905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 Sep 29 18:41:24 devstack sudo[94905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:25 devstack sudo[94905]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564" returned: 0 in 0.922s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:25 devstack sudo[94921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564 Sep 29 18:41:25 devstack sudo[94921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:25 devstack sudo[94921]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd.a7d380cd-ab61-4db5-b43c-0ca470a8e564" returned: 0 in 0.617s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "cinder-quobyte-a7d380cd-ab61-4db5-b43c-0ca470a8e564" released by "_delete_snapshot" :: held 3.040s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:41:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "cinder-quobyte-dea8b958-e309-4c0d-8c45-88e8c510c4bd" released by "delete_snapshot" :: held 3.115s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:41:26 devstack cinder-volume[86523]: DEBUG cinder.quota [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Created reservations ['e6eb541a-898d-4103-aaf6-aa48570c8739', 'f640b2f6-dc87-4d08-9b2b-40208f70adb5', 'ebfb4ab7-f914-4a71-ad4a-e9d668ec6131', 'f20df97c-3b89-43ee-820f-20849d0169b4'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:41:26 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Delete snapshot completed successfully. Sep 29 18:41:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-a18ca5f1-5f7e-4f97-8fb4-48c6f3205c7d req-17fac0d1-1d8d-4878-8994-a1317fbed0eb tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "cinder-a7d380cd-ab61-4db5-b43c-0ca470a8e564-delete_snapshot" released by "delete_snapshot" :: held 3.580s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:41:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Acquiring lock "cinder-dea8b958-e309-4c0d-8c45-88e8c510c4bd-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:41:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "cinder-dea8b958-e309-4c0d-8c45-88e8c510c4bd-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:41:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Acquiring lock "cinder-quobyte-dea8b958-e309-4c0d-8c45-88e8c510c4bd" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:41:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "cinder-quobyte-dea8b958-e309-4c0d-8c45-88e8c510c4bd" acquired by "delete_volume" :: waited 0.031s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:41:27 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b97a29d0-8866-4854-8f49-0fb04526f93e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:41:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:27 devstack sudo[94931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd Sep 29 18:41:27 devstack sudo[94931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:28 devstack sudo[94931]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd" returned: 0 in 0.645s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:28 devstack sudo[94936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd Sep 29 18:41:28 devstack sudo[94936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:28 devstack sudo[94936]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dea8b958-e309-4c0d-8c45-88e8c510c4bd" returned: 0 in 0.547s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "cinder-quobyte-dea8b958-e309-4c0d-8c45-88e8c510c4bd" released by "delete_volume" :: held 1.380s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:41:28 devstack cinder-volume[86523]: DEBUG cinder.quota [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Created reservations ['dc46c046-f5f4-4a23-a965-7ec586decaaf', '021588da-a5b6-4c6c-8a5f-3064776ded48', '04977300-d216-41d2-adb1-d1d54b8f45eb', '7306ae39-01bf-4672-8a6c-01ddef727b1a'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:41:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:41:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:41:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:41:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:41:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:41:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:29 devstack sudo[94941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:41:29 devstack sudo[94941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:29 devstack sudo[94941]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.500s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:29 devstack cinder-volume[86523]: DEBUG cinder.manager [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:41:29 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Deleted volume successfully. Sep 29 18:41:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-c138af7c-a33f-400e-95d2-a298912d60f4 req-138bd607-e88a-4a43-996b-16a99a631306 tempest-VolumesSnapshotsTestJSON-120352254 None] Lock "cinder-dea8b958-e309-4c0d-8c45-88e8c510c4bd-delete_volume" released by "delete_volume" :: held 2.333s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:41:32 devstack sudo[94885]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.aa8927f1-0600-4a5d-bc77-3f6742dba705pm00mlot.img" returned: 0 in 9.004s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:32 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[443b918b-022f-4291-85a8-ea68b18b2afc]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:41:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:32 devstack sudo[95001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be Sep 29 18:41:32 devstack sudo[95001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:33 devstack sudo[95001]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be" returned: 0 in 0.592s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:33 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be, size 1024.00 MB, duration 9.01 sec, destination /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.aa8927f1-0600-4a5d-bc77-3f6742dba705pm00mlot.img {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:41:33 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] Converted 1024.00 MB image at 113.71 MB/s Sep 29 18:41:33 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] aa8927f1-0600-4a5d-bc77-3f6742dba705 was raw, no need to convert to raw {{(pid=86523) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 29 18:41:43 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=30,cinder:UPDATE=26,cinder:INSERT=5,cinder:DELETE=4 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:41:43 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=25,cinder:SELECT=35,cinder:INSERT=8 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:41:43 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-057f607f-2b02-44a4-98d2-4a7ce072a716 req-22841459-9555-47e2-b072-b83c8cf56edd tempest-AttachVolumeTestJSON-226085023 None] Terminate volume connection completed successfully. Sep 29 18:41:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-057f607f-2b02-44a4-98d2-4a7ce072a716 req-22841459-9555-47e2-b072-b83c8cf56edd tempest-AttachVolumeTestJSON-226085023 None] Deleting attachment 21d92290-d047-448c-9df1-c3c5c26dc2ac. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:41:53 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=2 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:41:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:41:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:41:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:41:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:41:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:41:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:41:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:41:58 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:41:58 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:41:59 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Sep 29 18:41:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.579s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:41:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:41:59 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:41:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:41:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:42:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 39.752s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] Uploaded volume to glance image-id: aa8927f1-0600-4a5d-bc77-3f6742dba705. {{(pid=86523) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Sep 29 18:42:02 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ec2978ab-b14e-4a7c-924e-6bd017de3b6f tempest-VolumesActionsTest-311794192 None] Copy volume to image completed successfully. Sep 29 18:42:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:04 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d92b0f88-3a0a-4fea-a46e-f6f899b30660]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:04 devstack sudo[95264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be Sep 29 18:42:04 devstack sudo[95264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:04 devstack sudo[95264]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be" returned: 0 in 0.668s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:04 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[010fa61d-ccb9-4268-b735-c3605e23b3e6]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:05 devstack sudo[95269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be Sep 29 18:42:05 devstack sudo[95269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:05 devstack sudo[95269]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be" returned: 0 in 0.654s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:05 devstack sudo[95280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img Sep 29 18:42:05 devstack sudo[95280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:05 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-bbdd5fa5-82a7-44ae-a404-c76994674707 req-65828a47-1dde-4122-bc1f-ecd0ed7d4290 tempest-AttachVolumeNegativeTest-1308614236 None] Terminate volume connection completed successfully. Sep 29 18:42:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-bbdd5fa5-82a7-44ae-a404-c76994674707 req-65828a47-1dde-4122-bc1f-ecd0ed7d4290 tempest-AttachVolumeNegativeTest-1308614236 None] Deleting attachment a3203273-0e3a-467b-ab18-2c579dab21a0. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:42:06 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:42:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Flow 'volume_create_manager' (bcb1d041-d893-4d58-9da7-28d4673d5f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa27add2-9d1b-43d2-acbc-208e659d2479) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa27add2-9d1b-43d2-acbc-208e659d2479) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-772094378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bab330-ff67-4d80-a43b-28fb622ac8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce52157a6742dc8ba6cd3731d8ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:42:06Z,use_quota=True,user_id='660b9c95d0124cc3b353111e53d2cf52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d83276-57e7-4254-aa0b-5dacb751fce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d83276-57e7-4254-aa0b-5dacb751fce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57255983-3cd0-4ab1-870f-6d84c163d6be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57255983-3cd0-4ab1-870f-6d84c163d6be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47bab330-ff67-4d80-a43b-28fb622ac8a9', 'volume_name': 'volume-47bab330-ff67-4d80-a43b-28fb622ac8a9', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9d8e7b-fcac-47f0-8eee-e1ef62830779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b9d8e7b-fcac-47f0-8eee-e1ef62830779) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7962ec8-d393-446d-a004-4a6059113575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:06 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Volume 47bab330-ff67-4d80-a43b-28fb622ac8a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47bab330-ff67-4d80-a43b-28fb622ac8a9', 'volume_size': 1} Sep 29 18:42:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:15 devstack sudo[95280]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img" returned: 0 in 9.962s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:15 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e339e372-1479-4b15-a754-fed8c40e7296]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:15 devstack sudo[95345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be Sep 29 18:42:15 devstack sudo[95345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:16 devstack sudo[95345]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be" returned: 0 in 0.541s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:16 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be, size 1024.00 MB, duration 9.97 sec, destination /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:42:16 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Converted 1024.00 MB image at 102.75 MB/s Sep 29 18:42:16 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] 9254a957-eb65-40e8-a8d7-cb66bdbd4737 was raw, converting to qcow2 {{(pid=86523) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 29 18:42:16 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8536149-c72d-44bd-ba41-eb5c1b82f61a]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:16 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img Sep 29 18:42:16 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:16 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img" returned: 0 in 0.372s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:16 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img Sep 29 18:42:16 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:16 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img" returned: 1 in 0.320s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:42:16 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:42:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img /opt/stack/data/cinder/conversion/vol_upload_m4clow1w {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:16 devstack sudo[95359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img /opt/stack/data/cinder/conversion/vol_upload_m4clow1w Sep 29 18:42:16 devstack sudo[95359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:17 devstack sudo[95359]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img /opt/stack/data/cinder/conversion/vol_upload_m4clow1w" returned: 0 in 0.261s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:17 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Image conversion details: src /opt/stack/data/cinder/conversion/9e29f85c-d173-4738-893d-fec5097bb2be.temp_image.9254a957-eb65-40e8-a8d7-cb66bdbd47370kdvpiqh.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_m4clow1w {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:42:17 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 29 18:42:17 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[448eeeb1-c5f7-42b3-bf91-5048efd2bf4e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m4clow1w {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:17 devstack sudo[95365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m4clow1w Sep 29 18:42:17 devstack sudo[95365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:17 devstack sudo[95365]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m4clow1w" returned: 0 in 0.344s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.678s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Uploaded volume to glance image-id: 9254a957-eb65-40e8-a8d7-cb66bdbd4737. {{(pid=86523) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Sep 29 18:42:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.917s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:42:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-772094378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47bab330-ff67-4d80-a43b-28fb622ac8a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='43ce52157a6742dc8ba6cd3731d8ae51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:42:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:42:06Z,use_quota=True,user_id='660b9c95d0124cc3b353111e53d2cf52',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:42:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Creating volume 47bab330-ff67-4d80-a43b-28fb622ac8a9 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:42:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:42:18 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:42:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-47bab330-ff67-4d80-a43b-28fb622ac8a9 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:18 devstack sudo[95374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-47bab330-ff67-4d80-a43b-28fb622ac8a9 1073741824 Sep 29 18:42:18 devstack sudo[95374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:18 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-85198a5f-c4e0-446c-997f-a52619f8372c tempest-VolumesActionsTest-311794192 None] Copy volume to image completed successfully. Sep 29 18:42:19 devstack sudo[95374]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-47bab330-ff67-4d80-a43b-28fb622ac8a9 1073741824" returned: 0 in 0.534s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-47bab330-ff67-4d80-a43b-28fb622ac8a9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:19 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-47bab330-ff67-4d80-a43b-28fb622ac8a9 Sep 29 18:42:19 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:19 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-47bab330-ff67-4d80-a43b-28fb622ac8a9" returned: 0 in 0.309s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:42:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7962ec8-d393-446d-a004-4a6059113575) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47bab330-ff67-4d80-a43b-28fb622ac8a9', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c648f8f3-8fd1-4f4f-9fb9-c93d520fa08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:19 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Volume volume-47bab330-ff67-4d80-a43b-28fb622ac8a9 (47bab330-ff67-4d80-a43b-28fb622ac8a9): created successfully Sep 29 18:42:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c648f8f3-8fd1-4f4f-9fb9-c93d520fa08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Flow 'volume_create_manager' (bcb1d041-d893-4d58-9da7-28d4673d5f7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:19 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-476528db-91e4-485a-a516-c6a088e9c258 tempest-VolumeQuotasNegativeTestJSON-243037565 None] Created volume successfully. Sep 29 18:42:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Acquiring lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Acquiring lock "cinder-quobyte-9e29f85c-d173-4738-893d-fec5097bb2be" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Lock "cinder-quobyte-9e29f85c-d173-4738-893d-fec5097bb2be" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:20 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e6485c-e338-4196-a12d-2cc6d0529368]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:20 devstack sudo[95393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be Sep 29 18:42:20 devstack sudo[95393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:20 devstack sudo[95393]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be" returned: 0 in 0.514s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:20 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be Sep 29 18:42:20 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:20 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e29f85c-d173-4738-893d-fec5097bb2be" returned: 0 in 0.289s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Lock "cinder-quobyte-9e29f85c-d173-4738-893d-fec5097bb2be" released by "delete_volume" :: held 0.851s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Created reservations ['b1e2af01-300c-479a-9ce1-ea55375a1f04', '89d89731-b37a-4c6d-a849-63f6fb019004', 'b1d38adb-78e1-42e6-a85a-12ed7046896c', 'b96fe6c1-adc2-4424-8479-93bfe135287f'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:21 devstack sudo[95406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:42:21 devstack sudo[95406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:21 devstack sudo[95406]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.362s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:42:21 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Deleted volume successfully. Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6e1e483a-db30-4c06-8c40-258155d6352d tempest-VolumesActionsTest-311794192 None] Lock "cinder-9e29f85c-d173-4738-893d-fec5097bb2be-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Acquiring lock "cinder-47bab330-ff67-4d80-a43b-28fb622ac8a9-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Lock "cinder-47bab330-ff67-4d80-a43b-28fb622ac8a9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Acquiring lock "cinder-quobyte-47bab330-ff67-4d80-a43b-28fb622ac8a9" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Lock "cinder-quobyte-47bab330-ff67-4d80-a43b-28fb622ac8a9" acquired by "delete_volume" :: waited 0.040s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0b3d547-8174-42fd-92a4-0bd68a0d38f0]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-47bab330-ff67-4d80-a43b-28fb622ac8a9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:22 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-47bab330-ff67-4d80-a43b-28fb622ac8a9 Sep 29 18:42:22 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:22 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-47bab330-ff67-4d80-a43b-28fb622ac8a9" returned: 0 in 0.866s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-47bab330-ff67-4d80-a43b-28fb622ac8a9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:22 devstack sudo[95429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-47bab330-ff67-4d80-a43b-28fb622ac8a9 Sep 29 18:42:22 devstack sudo[95429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:23 devstack sudo[95429]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-47bab330-ff67-4d80-a43b-28fb622ac8a9" returned: 0 in 0.597s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Lock "cinder-quobyte-47bab330-ff67-4d80-a43b-28fb622ac8a9" released by "delete_volume" :: held 1.562s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:23 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Created reservations ['1882a5ab-5dc7-45f2-a546-77fe1d31b55c', 'f368c3b9-7b4a-4fa4-a320-ea677ac7ad7f', 'b94b49cf-58d6-4cd8-befd-2b92086d1161', 'a9bb4c0a-423f-42b5-ba65-c34d844f5a02'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:42:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:23 devstack sudo[95475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:42:23 devstack sudo[95475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:24 devstack sudo[95475]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.297s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:24 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:42:24 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Deleted volume successfully. Sep 29 18:42:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ca6da1ef-11d0-4b18-b15f-47beeb07afec tempest-VolumeQuotasNegativeTestJSON-243037565 None] Lock "cinder-47bab330-ff67-4d80-a43b-28fb622ac8a9-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Flow 'volume_create_manager' (30da2f99-f65f-407a-aab7-2529a742e871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7c85c8-39be-4e37-886f-93837f2d1658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7c85c8-39be-4e37-886f-93837f2d1658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-222267834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b35786b-b833-4f78-a71d-b5624a102ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a875a39661e4d0da20cf2318c538036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:42:26Z,use_quota=True,user_id='14e02c5f829744d8b0f40875391b5f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d60b99-2081-46af-9779-ef8f6a45f47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6d60b99-2081-46af-9779-ef8f6a45f47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2a9723-25ba-4ccf-bb16-7094d108e914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2a9723-25ba-4ccf-bb16-7094d108e914) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b35786b-b833-4f78-a71d-b5624a102ecf', 'volume_name': 'volume-6b35786b-b833-4f78-a71d-b5624a102ecf', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9539000d-56ac-4d51-b4fc-0e90d4f494b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9539000d-56ac-4d51-b4fc-0e90d4f494b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb73e34b-ec39-4747-8cbb-1d5e76acc6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:26 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Volume 6b35786b-b833-4f78-a71d-b5624a102ecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b35786b-b833-4f78-a71d-b5624a102ecf', 'volume_size': 1} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:42:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-222267834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b35786b-b833-4f78-a71d-b5624a102ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a875a39661e4d0da20cf2318c538036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:42:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:42:26Z,use_quota=True,user_id='14e02c5f829744d8b0f40875391b5f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Creating volume 6b35786b-b833-4f78-a71d-b5624a102ecf {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:42:26 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:42:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b35786b-b833-4f78-a71d-b5624a102ecf 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:26 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b35786b-b833-4f78-a71d-b5624a102ecf 1073741824 Sep 29 18:42:26 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:27 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b35786b-b833-4f78-a71d-b5624a102ecf 1073741824" returned: 0 in 0.755s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b35786b-b833-4f78-a71d-b5624a102ecf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:27 devstack sudo[95515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b35786b-b833-4f78-a71d-b5624a102ecf Sep 29 18:42:27 devstack sudo[95515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:27 devstack sudo[95515]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b35786b-b833-4f78-a71d-b5624a102ecf" returned: 0 in 0.349s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:42:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb73e34b-ec39-4747-8cbb-1d5e76acc6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b35786b-b833-4f78-a71d-b5624a102ecf', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f27fe8-97b8-432a-b12d-fb962e88ca7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:27 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Volume volume-6b35786b-b833-4f78-a71d-b5624a102ecf (6b35786b-b833-4f78-a71d-b5624a102ecf): created successfully Sep 29 18:42:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f27fe8-97b8-432a-b12d-fb962e88ca7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Flow 'volume_create_manager' (30da2f99-f65f-407a-aab7-2529a742e871) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-9b99ca0a-2540-4265-881c-ca1e88e2ecb9 tempest-AttachVolumeTestJSON-226085023 None] Created volume successfully. Sep 29 18:42:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-ff63a0e6-4411-4527-b694-90bce8de2045 req-3b28a0d5-865b-4cbb-9185-8b75181d5353 tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-ff63a0e6-4411-4527-b694-90bce8de2045 req-3b28a0d5-865b-4cbb-9185-8b75181d5353 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-ff63a0e6-4411-4527-b694-90bce8de2045 req-3b28a0d5-865b-4cbb-9185-8b75181d5353 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-ff63a0e6-4411-4527-b694-90bce8de2045 req-3b28a0d5-865b-4cbb-9185-8b75181d5353 tempest-AttachVolumeTestJSON-226085023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-6b35786b-b833-4f78-a71d-b5624a102ecf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0ae4f19-e128-4079-8667-458bfc5db90b', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:42:29 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-ff63a0e6-4411-4527-b694-90bce8de2045 req-3b28a0d5-865b-4cbb-9185-8b75181d5353 tempest-AttachVolumeTestJSON-226085023 None] attachment_update completed successfully. Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Flow 'volume_create_manager' (104f2e74-febd-48c6-b177-24c88e5d17c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144ef64d-a5a4-42db-bc19-12c44ad37770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (144ef64d-a5a4-42db-bc19-12c44ad37770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-442740029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=899429ad-c114-446e-a2aa-d5d09661be33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a875a39661e4d0da20cf2318c538036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:42:33Z,use_quota=True,user_id='14e02c5f829744d8b0f40875391b5f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ee6699-3995-4388-8d74-2cbd353e8f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4ee6699-3995-4388-8d74-2cbd353e8f59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257cbd3e-8095-4143-a96f-29c7b65ecd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (257cbd3e-8095-4143-a96f-29c7b65ecd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '899429ad-c114-446e-a2aa-d5d09661be33', 'volume_name': 'volume-899429ad-c114-446e-a2aa-d5d09661be33', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b239b2-7e3c-40cc-8023-610d5beee8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76b239b2-7e3c-40cc-8023-610d5beee8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fd90c2-bf22-412b-9597-a1da464644d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:32 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Volume 899429ad-c114-446e-a2aa-d5d09661be33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-899429ad-c114-446e-a2aa-d5d09661be33', 'volume_size': 1} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:42:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-442740029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=899429ad-c114-446e-a2aa-d5d09661be33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a875a39661e4d0da20cf2318c538036',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:42:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:42:33Z,use_quota=True,user_id='14e02c5f829744d8b0f40875391b5f15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Creating volume 899429ad-c114-446e-a2aa-d5d09661be33 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:42:32 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:42:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-899429ad-c114-446e-a2aa-d5d09661be33 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:32 devstack sudo[95955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-899429ad-c114-446e-a2aa-d5d09661be33 1073741824 Sep 29 18:42:32 devstack sudo[95955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:33 devstack sudo[95955]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-899429ad-c114-446e-a2aa-d5d09661be33 1073741824" returned: 0 in 0.558s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-899429ad-c114-446e-a2aa-d5d09661be33 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:33 devstack sudo[95961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-899429ad-c114-446e-a2aa-d5d09661be33 Sep 29 18:42:33 devstack sudo[95961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:33 devstack sudo[95961]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-899429ad-c114-446e-a2aa-d5d09661be33" returned: 0 in 0.383s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:33 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:42:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3fd90c2-bf22-412b-9597-a1da464644d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-899429ad-c114-446e-a2aa-d5d09661be33', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77a0bca-f485-445a-a719-2cba3d409a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:33 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Volume volume-899429ad-c114-446e-a2aa-d5d09661be33 (899429ad-c114-446e-a2aa-d5d09661be33): created successfully Sep 29 18:42:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77a0bca-f485-445a-a719-2cba3d409a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Flow 'volume_create_manager' (104f2e74-febd-48c6-b177-24c88e5d17c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:33 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8a359021-5588-4b30-a836-b04c63d04634 tempest-AttachVolumeTestJSON-226085023 None] Created volume successfully. Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Flow 'volume_create_manager' (543d5d1b-d813-445b-ac1a-31f23b26af67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75c47bb-c9eb-4288-bf7b-c8f1d4cbe305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75c47bb-c9eb-4288-bf7b-c8f1d4cbe305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-937510093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cfaf8be-7779-4b00-a81d-783bcc4309f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1442ed9af9460ca8330354ed9197b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:42:35Z,use_quota=True,user_id='cfc005f413854b98b8764bbb1f04608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae2c357-5f61-4cdd-adf1-a3c63ec2c006),volume_type_id=6ae2c357-5f61-4cdd-adf1-a3c63ec2c006)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d9df5f-2a1b-4fe6-8ccd-7b875faeec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95d9df5f-2a1b-4fe6-8ccd-7b875faeec30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9d72e3-5605-43cb-8841-c20b11e21b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d9d72e3-5605-43cb-8841-c20b11e21b21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cfaf8be-7779-4b00-a81d-783bcc4309f7', 'volume_name': 'volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5cfa34-c253-4e2a-8d83-5de745b5ad32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca5cfa34-c253-4e2a-8d83-5de745b5ad32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc514fa-694b-48c0-8bd5-72d43cad094f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:35 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Volume 0cfaf8be-7779-4b00-a81d-783bcc4309f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7', 'volume_size': 1} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-937510093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cfaf8be-7779-4b00-a81d-783bcc4309f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e1442ed9af9460ca8330354ed9197b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:42:35Z,use_quota=True,user_id='cfc005f413854b98b8764bbb1f04608c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6ae2c357-5f61-4cdd-adf1-a3c63ec2c006),volume_type_id=6ae2c357-5f61-4cdd-adf1-a3c63ec2c006)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Creating volume 0cfaf8be-7779-4b00-a81d-783bcc4309f7 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:42:35 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:35 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7 1073741824 Sep 29 18:42:35 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Flow 'volume_create_manager' (5f782bd7-2c92-4773-86bd-540387edf596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83fb641-ca32-4685-a3d6-385357f9c4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b83fb641-ca32-4685-a3d6-385357f9c4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1938693288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea258b12fad1478eb767f68f01756e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:42:35Z,use_quota=True,user_id='6b6ee75bae2349d3ba412c125c3b8913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4722e77e-c4ae-4b74-a2cb-a0574fb3ea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4722e77e-c4ae-4b74-a2cb-a0574fb3ea10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89acb3a1-4826-40a6-a13e-3b81239ec764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89acb3a1-4826-40a6-a13e-3b81239ec764) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75', 'volume_name': 'volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee3f7a8-8dd3-4f8c-b8f7-f2340d6dbab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ee3f7a8-8dd3-4f8c-b8f7-f2340d6dbab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ce4061-e738-4432-81cb-1923d5047d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:35 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Volume 5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75', 'volume_size': 1} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-45a8b6d4-f185-4a5a-962c-8baf21bb48af req-9c6f1471-e4f7-484c-bce4-e4f388717dab tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:35 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7 1073741824" returned: 0 in 0.447s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:35 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7 Sep 29 18:42:35 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:36 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7" returned: 0 in 0.259s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.539s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:42:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1938693288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea258b12fad1478eb767f68f01756e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:42:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:42:35Z,use_quota=True,user_id='6b6ee75bae2349d3ba412c125c3b8913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Creating volume 5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:42:36 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fc514fa-694b-48c0-8bd5-72d43cad094f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad76b1d1-9c1f-4755-bbdd-4a46c2040401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:36 devstack sudo[95987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 1073741824 Sep 29 18:42:36 devstack sudo[95987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:36 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Volume volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7 (0cfaf8be-7779-4b00-a81d-783bcc4309f7): created successfully Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad76b1d1-9c1f-4755-bbdd-4a46c2040401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Flow 'volume_create_manager' (543d5d1b-d813-445b-ac1a-31f23b26af67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:36 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6887674c-87cb-4ceb-b5a9-99fb8d087def tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Created volume successfully. Sep 29 18:42:36 devstack sudo[95987]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 1073741824" returned: 0 in 0.439s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:36 devstack sudo[95992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 Sep 29 18:42:36 devstack sudo[95992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:36 devstack sudo[95992]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75" returned: 0 in 0.248s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-45a8b6d4-f185-4a5a-962c-8baf21bb48af req-9c6f1471-e4f7-484c-bce4-e4f388717dab tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.256s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4ce4061-e738-4432-81cb-1923d5047d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babbe165-e511-4d8c-acda-9e94197f8421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-45a8b6d4-f185-4a5a-962c-8baf21bb48af req-9c6f1471-e4f7-484c-bce4-e4f388717dab tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:36 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Volume volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 (5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75): created successfully Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babbe165-e511-4d8c-acda-9e94197f8421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Flow 'volume_create_manager' (5f782bd7-2c92-4773-86bd-540387edf596) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:36 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e5595a50-b71a-4bba-a211-ffeeb793a646 tempest-VolumesCloneTest-1074633863 None] Created volume successfully. Sep 29 18:42:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-45a8b6d4-f185-4a5a-962c-8baf21bb48af req-9c6f1471-e4f7-484c-bce4-e4f388717dab tempest-AttachVolumeTestJSON-226085023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-899429ad-c114-446e-a2aa-d5d09661be33', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac4e5cea-8b96-4ed0-a93e-b88ce26182f8', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:42:36 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-45a8b6d4-f185-4a5a-962c-8baf21bb48af req-9c6f1471-e4f7-484c-bce4-e4f388717dab tempest-AttachVolumeTestJSON-226085023 None] attachment_update completed successfully. Sep 29 18:42:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f3ce961e-a6c1-4da8-8085-52fa71ffca79 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f3ce961e-a6c1-4da8-8085-52fa71ffca79 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f3ce961e-a6c1-4da8-8085-52fa71ffca79 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f3ce961e-a6c1-4da8-8085-52fa71ffca79 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f3ce961e-a6c1-4da8-8085-52fa71ffca79 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f3ce961e-a6c1-4da8-8085-52fa71ffca79 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:37 devstack sudo[96000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:42:37 devstack sudo[96000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:37 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Flow 'volume_create_manager' (f8d5fd22-d6df-4f37-b99f-2708d3b83b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcabf55a-d17a-459e-b5b5-d08229371f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcabf55a-d17a-459e-b5b5-d08229371f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:42:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1415995636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db501419-690d-4b22-b0f2-81a9447ae764,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea258b12fad1478eb767f68f01756e8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:42:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75,status='creating',terminated_at=None,updated_at=2026-09-29T16:42:38Z,use_quota=True,user_id='6b6ee75bae2349d3ba412c125c3b8913',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c992c8-cfac-411a-8f78-4199ad252c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c992c8-cfac-411a-8f78-4199ad252c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29de1243-58bf-4656-9c17-7be70202fbf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29de1243-58bf-4656-9c17-7be70202fbf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'db501419-690d-4b22-b0f2-81a9447ae764', 'volume_name': 'volume-db501419-690d-4b22-b0f2-81a9447ae764', 'volume_size': 2, 'source_volid': '5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75', 'source_volstatus': 'available'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64292cf-067a-49f5-ab64-adc33c0fa3da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d64292cf-067a-49f5-ab64-adc33c0fa3da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687f734b-182d-4ce5-8764-7d7ffb34fe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:38 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Volume db501419-690d-4b22-b0f2-81a9447ae764: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-db501419-690d-4b22-b0f2-81a9447ae764', 'volume_size': 2, 'source_volid': '5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75', 'source_volstatus': 'available'} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:38 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Cloning volume 5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 to volume db501419-690d-4b22-b0f2-81a9447ae764 Sep 29 18:42:38 devstack sudo[96000]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Creating offline snapshot 6a497d04-8d0d-43b9-938e-c182d0a5e0e4 of volume 5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f3ce961e-a6c1-4da8-8085-52fa71ffca79 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.394s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-f3ce961e-a6c1-4da8-8085-52fa71ffca79 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:42:38 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f3ce961e-a6c1-4da8-8085-52fa71ffca79 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Retype volume completed successfully. Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7966f1-0613-4428-8884-ae6e1fd2a36d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:38 devstack sudo[96015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 Sep 29 18:42:38 devstack sudo[96015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:38 devstack sudo[96015]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75" returned: 0 in 0.406s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:38 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 1G Sep 29 18:42:38 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:39 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 1G" returned: 0 in 0.470s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Acquiring lock "cinder-0cfaf8be-7779-4b00-a81d-783bcc4309f7-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:39 devstack sudo[96030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 Sep 29 18:42:39 devstack sudo[96030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Lock "cinder-0cfaf8be-7779-4b00-a81d-783bcc4309f7-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Acquiring lock "cinder-quobyte-0cfaf8be-7779-4b00-a81d-783bcc4309f7" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Lock "cinder-quobyte-0cfaf8be-7779-4b00-a81d-783bcc4309f7" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93201c7-2d91-4bfb-b368-73f387d5eb5d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:39 devstack sudo[96032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7 Sep 29 18:42:39 devstack sudo[96032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:39 devstack sudo[96030]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4" returned: 0 in 0.375s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:39 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 is being set with open permissions: ugo+rw Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:39 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 Sep 29 18:42:39 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:39 devstack sudo[96032]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7" returned: 0 in 0.429s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:39 devstack sudo[96043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7 Sep 29 18:42:39 devstack sudo[96043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:39 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4" returned: 0 in 0.265s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:39 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.info Sep 29 18:42:39 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:39 devstack sudo[96043]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:39 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-c15d4534-1dc5-4d92-96c9-41fce56d8999 req-a053ccf5-9544-4338-8af2-3a3875d9cb50 tempest-AttachVolumeTestJSON-226085023 None] Terminate volume connection completed successfully. Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-c15d4534-1dc5-4d92-96c9-41fce56d8999 req-a053ccf5-9544-4338-8af2-3a3875d9cb50 tempest-AttachVolumeTestJSON-226085023 None] Deleting attachment f0ae4f19-e128-4079-8667-458bfc5db90b. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0cfaf8be-7779-4b00-a81d-783bcc4309f7" returned: 0 in 0.266s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Lock "cinder-quobyte-0cfaf8be-7779-4b00-a81d-783bcc4309f7" released by "delete_volume" :: held 0.751s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:40 devstack cinder-volume[86523]: WARNING cinder.quota [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:42:40 devstack cinder-volume[86523]: WARNING cinder.quota [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Created reservations ['a19b3865-0c89-42df-a7e1-4409d5a70a98', '37617063-7671-426e-94ff-3dd7911e9b35', 'd7505c8e-3c9b-4608-be86-45b8c1b2456a', '2a6de9cd-5e4e-4875-b085-5c13341699a5'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:42:40 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.info" returned: 0 in 0.288s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:40 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.info is being set with open permissions: ugo+rw Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:40 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.info Sep 29 18:42:40 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:40 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:42:40 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:40 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.info" returned: 0 in 0.260s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Acquiring lock "cinder-quobyte-db501419-690d-4b22-b0f2-81a9447ae764" by "_copy_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Lock "cinder-quobyte-db501419-690d-4b22-b0f2-81a9447ae764" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] snapshot: 6a497d04-8d0d-43b9-938e-c182d0a5e0e4, volume: db501419-690d-4b22-b0f2-81a9447ae764, {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:40 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.307s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5281b4-4768-483d-bf9f-bda3efd9bba5]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:40 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Deleted volume successfully. Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7f3d1f24-b1a2-45bc-9499-89ac7542ba23 tempest-VolumeRetypeWithoutMigrationTest-1106938259 None] Lock "cinder-0cfaf8be-7779-4b00-a81d-783bcc4309f7-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:40 devstack sudo[96060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 Sep 29 18:42:40 devstack sudo[96060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:40 devstack sudo[96060]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4" returned: 0 in 0.452s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e3e4d5-93f1-4b06-b0bc-2656ffe847a0]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:41 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 Sep 29 18:42:41 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:41 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75" returned: 0 in 0.423s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:42:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Creating direct copy from snapshot {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:42:41 devstack cinder-volume[86523]: DEBUG cinder.utils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Path /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764 not found in is_blk_device check {{(pid=86523) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:42:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:41 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764 Sep 29 18:42:41 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:41 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-0e974c4e-577a-4396-a43c-75dea2ff3f32 req-241b4d71-a040-4d68-b00f-37c52fe3b985 tempest-AttachVolumeTestJSON-226085023 None] Terminate volume connection completed successfully. Sep 29 18:42:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-0e974c4e-577a-4396-a43c-75dea2ff3f32 req-241b4d71-a040-4d68-b00f-37c52fe3b985 tempest-AttachVolumeTestJSON-226085023 None] Deleting attachment ac4e5cea-8b96-4ed0-a93e-b88ce26182f8. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:42:51 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764" returned: 0 in 9.823s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:51 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75, size 1024.00 MB, duration 9.82 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:42:51 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Converted 1024.00 MB image at 104.24 MB/s Sep 29 18:42:51 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764 is being set with open permissions: ugo+rw Sep 29 18:42:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:51 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764 Sep 29 18:42:51 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:51 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764" returned: 0 in 0.276s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Lock "cinder-quobyte-db501419-690d-4b22-b0f2-81a9447ae764" released by "_copy_volume_from_snapshot" :: held 11.089s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Acquiring lock "cinder-quobyte-6a497d04-8d0d-43b9-938e-c182d0a5e0e4" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Lock "cinder-quobyte-6a497d04-8d0d-43b9-938e-c182d0a5e0e4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Deleting offline snapshot 6a497d04-8d0d-43b9-938e-c182d0a5e0e4 of volume 5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:42:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] snapshot_file for this snap is: volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:42:51 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=48,cinder:UPDATE=48,cinder:INSERT=8,cinder:DELETE=4 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:42:51 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[69696a6c-4a1b-4e56-9564-053868293008]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:51 devstack sudo[96189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 Sep 29 18:42:51 devstack sudo[96189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:52 devstack sudo[96189]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4" returned: 0 in 0.473s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a4cfc5e-dcc7-45c4-8706-8100f834980d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:42:52 devstack sudo[96194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 Sep 29 18:42:52 devstack sudo[96194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Flow 'volume_create_manager' (2ac7fc83-9ed6-4fa9-8888-3e4493de2602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199967e7-807c-4132-99b3-07921e0c2ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (199967e7-807c-4132-99b3-07921e0c2ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-98885367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c606eb586e8e4aef82c94f12f7ce7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:42:52Z,use_quota=True,user_id='2e9bebf527b74793ad4b1aef9e3759c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ff0fb8-e0a2-46f4-99d8-6b685eadd873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77ff0fb8-e0a2-46f4-99d8-6b685eadd873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b9c378-690e-45b9-b7e4-6e16db57896a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b9c378-690e-45b9-b7e4-6e16db57896a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7', 'volume_name': 'volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8ece9a-4ffb-48c0-a0bf-b11d22128391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f8ece9a-4ffb-48c0-a0bf-b11d22128391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e69d2b6-888e-4048-bdd1-ff9f72c223e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:52 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Volume d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7', 'volume_size': 1} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "cinder-899429ad-c114-446e-a2aa-d5d09661be33-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Lock "cinder-899429ad-c114-446e-a2aa-d5d09661be33-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "cinder-quobyte-899429ad-c114-446e-a2aa-d5d09661be33" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Lock "cinder-quobyte-899429ad-c114-446e-a2aa-d5d09661be33" acquired by "delete_volume" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a39fa5b-9a46-4037-a51e-1d503b7a8658]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-899429ad-c114-446e-a2aa-d5d09661be33 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:52 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-899429ad-c114-446e-a2aa-d5d09661be33 Sep 29 18:42:52 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:52 devstack sudo[96194]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75" returned: 0 in 0.654s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:52 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 Sep 29 18:42:52 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:52 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-899429ad-c114-446e-a2aa-d5d09661be33" returned: 0 in 0.434s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-899429ad-c114-446e-a2aa-d5d09661be33 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:52 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-899429ad-c114-446e-a2aa-d5d09661be33 Sep 29 18:42:52 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:53 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4" returned: 0 in 0.457s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:53 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-899429ad-c114-446e-a2aa-d5d09661be33" returned: 0 in 0.304s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:53 devstack sudo[96214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4 Sep 29 18:42:53 devstack sudo[96214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Lock "cinder-quobyte-899429ad-c114-446e-a2aa-d5d09661be33" released by "delete_volume" :: held 0.791s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=61,cinder:UPDATE=50,cinder:DELETE=4,cinder:INSERT=11 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Created reservations ['56843d96-93fa-47ef-bdff-fb9ef41c25f3', '291581f7-bc37-43ec-acf3-2e2015c65e36', '4729e028-804c-4337-b31e-5c82083dfbcc', 'a4eac3be-78ae-4899-b844-ce8913efd4d4'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:53 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:42:53 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:53 devstack sudo[96214]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75.6a497d04-8d0d-43b9-938e-c182d0a5e0e4" returned: 0 in 0.298s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "cinder-6b35786b-b833-4f78-a71d-b5624a102ecf-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Lock "cinder-quobyte-6a497d04-8d0d-43b9-938e-c182d0a5e0e4" released by "_delete_snapshot" :: held 2.092s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Lock "cinder-6b35786b-b833-4f78-a71d-b5624a102ecf-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.514s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.306s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-98885367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c606eb586e8e4aef82c94f12f7ce7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:42:52Z,use_quota=True,user_id='2e9bebf527b74793ad4b1aef9e3759c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Creating volume d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:42:53 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "cinder-quobyte-6b35786b-b833-4f78-a71d-b5624a102ecf" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:53 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:53 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7 1073741824 Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (687f734b-182d-4ce5-8764-7d7ffb34fe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db501419-690d-4b22-b0f2-81a9447ae764', 'volume_size': 2, 'source_volid': '5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75', 'source_volstatus': 'available'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:53 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f569d7eb-2077-4994-bcca-e940aed05d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.325s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Lock "cinder-quobyte-6b35786b-b833-4f78-a71d-b5624a102ecf" acquired by "delete_volume" :: waited 0.038s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:53 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Volume volume-db501419-690d-4b22-b0f2-81a9447ae764 (db501419-690d-4b22-b0f2-81a9447ae764): created successfully Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f569d7eb-2077-4994-bcca-e940aed05d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Flow 'volume_create_manager' (f8d5fd22-d6df-4f37-b99f-2708d3b83b9f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:53 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Deleted volume successfully. Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a40ee94-9e23-4cbe-a6de-f394f24935ce]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b35786b-b833-4f78-a71d-b5624a102ecf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:53 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a7191227-1ff0-48ca-bd70-b2d1b074c780 tempest-VolumesCloneTest-1074633863 None] Created volume successfully. Sep 29 18:42:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9d17dc8d-0117-49f9-a330-99b94120192a tempest-AttachVolumeTestJSON-226085023 None] Lock "cinder-899429ad-c114-446e-a2aa-d5d09661be33-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:53 devstack sudo[96222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b35786b-b833-4f78-a71d-b5624a102ecf Sep 29 18:42:53 devstack sudo[96222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:54 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7 1073741824" returned: 0 in 0.487s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:54 devstack sudo[96222]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b35786b-b833-4f78-a71d-b5624a102ecf" returned: 0 in 0.439s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b35786b-b833-4f78-a71d-b5624a102ecf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:54 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7 Sep 29 18:42:54 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:54 devstack sudo[96233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b35786b-b833-4f78-a71d-b5624a102ecf Sep 29 18:42:54 devstack sudo[96233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:54 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:54 devstack sudo[96233]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7" returned: 0 in 0.306s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.841s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6b35786b-b833-4f78-a71d-b5624a102ecf" returned: 0 in 0.287s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Lock "cinder-quobyte-6b35786b-b833-4f78-a71d-b5624a102ecf" released by "delete_volume" :: held 0.793s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e69d2b6-888e-4048-bdd1-ff9f72c223e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3fa452-6e02-4e82-9739-d0ee558c0c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:42:54 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Volume volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7 (d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7): created successfully Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa3fa452-6e02-4e82-9739-d0ee558c0c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Flow 'volume_create_manager' (2ac7fc83-9ed6-4fa9-8888-3e4493de2602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:42:54 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-617153ac-f569-45b2-94eb-00327ea33c47 tempest-AttachVolumeNegativeTest-1308614236 None] Created volume successfully. Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Created reservations ['54ea53b6-8165-4441-b230-8673b853e180', '16f70439-7b82-416e-98dd-4263557e61f1', '443e3166-aebd-4ff3-935a-2e64fc1facdb', '0633c121-916d-403a-bb83-26f7201134d2'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:54 devstack sudo[96237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:42:54 devstack sudo[96237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "cinder-8a4daacc-08fe-4f2f-8754-f28b0e035f5c-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Lock "cinder-8a4daacc-08fe-4f2f-8754-f28b0e035f5c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "cinder-quobyte-8a4daacc-08fe-4f2f-8754-f28b0e035f5c" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Lock "cinder-quobyte-8a4daacc-08fe-4f2f-8754-f28b0e035f5c" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:55 devstack sudo[96237]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d27a4d-07f2-4012-94d0-3de210c3a062]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.413s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:42:55 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Deleted volume successfully. Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41e7adfd-e539-484c-9717-a47fb47f5454 tempest-AttachVolumeTestJSON-226085023 None] Lock "cinder-6b35786b-b833-4f78-a71d-b5624a102ecf-delete_volume" released by "delete_volume" :: held 1.547s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:55 devstack sudo[96240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c Sep 29 18:42:55 devstack sudo[96240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:55 devstack sudo[96240]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c" returned: 0 in 0.573s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Acquiring lock "cinder-db501419-690d-4b22-b0f2-81a9447ae764-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:55 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c Sep 29 18:42:55 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Lock "cinder-db501419-690d-4b22-b0f2-81a9447ae764-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Acquiring lock "cinder-quobyte-db501419-690d-4b22-b0f2-81a9447ae764" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Lock "cinder-quobyte-db501419-690d-4b22-b0f2-81a9447ae764" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9041736e-26c8-4b96-bf4a-b33d9c37d74f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:56 devstack sudo[96250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764 Sep 29 18:42:56 devstack sudo[96250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:56 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a4daacc-08fe-4f2f-8754-f28b0e035f5c" returned: 0 in 0.425s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Lock "cinder-quobyte-8a4daacc-08fe-4f2f-8754-f28b0e035f5c" released by "delete_volume" :: held 1.075s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Created reservations ['f8798396-9da3-4402-9302-9fc9f08f6a40', '096c6ce5-339e-4fc1-9305-3b177b7273d8', 'ea828e29-96ed-408c-bcbd-7a8ac2ee4b05', 'a8757cdb-ca76-4cc6-9501-ba9e99de0d16'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:56 devstack sudo[96261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:42:56 devstack sudo[96261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f8f247cf-5c84-4933-90fe-08f8b6d17f27 req-ad6624ce-abb1-4ec9-bec5-d8750f87cefd tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f8f247cf-5c84-4933-90fe-08f8b6d17f27 req-ad6624ce-abb1-4ec9-bec5-d8750f87cefd tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:56 devstack sudo[96250]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764" returned: 0 in 0.598s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f8f247cf-5c84-4933-90fe-08f8b6d17f27 req-ad6624ce-abb1-4ec9-bec5-d8750f87cefd tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:56 devstack sudo[96266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764 Sep 29 18:42:56 devstack sudo[96266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f8f247cf-5c84-4933-90fe-08f8b6d17f27 req-ad6624ce-abb1-4ec9-bec5-d8750f87cefd tempest-AttachVolumeNegativeTest-1308614236 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c907bcb9-6718-48bb-bcb9-d7dd90592ec7', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:42:56 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-f8f247cf-5c84-4933-90fe-08f8b6d17f27 req-ad6624ce-abb1-4ec9-bec5-d8750f87cefd tempest-AttachVolumeNegativeTest-1308614236 None] attachment_update completed successfully. Sep 29 18:42:56 devstack sudo[96266]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:56 devstack sudo[96261]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db501419-690d-4b22-b0f2-81a9447ae764" returned: 0 in 0.307s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.490s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Lock "cinder-quobyte-db501419-690d-4b22-b0f2-81a9447ae764" released by "delete_volume" :: held 0.982s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:56 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Deleted volume successfully. Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6dca55ba-4dac-4314-aacb-6d8c65b4b1fd tempest-AttachVolumeTestJSON-226085023 None] Lock "cinder-8a4daacc-08fe-4f2f-8754-f28b0e035f5c-delete_volume" released by "delete_volume" :: held 1.916s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:56 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Created reservations ['d6eee45a-72bf-406a-8e7a-48fc4a9dbcb2', '331948f2-3e23-44d4-8202-06e3ab97c7ea', 'fc4a1b29-9881-47c1-9be9-a6b0553b8dd9', 'bec9916a-9816-4405-b25e-da49c2611b4c'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:42:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:57 devstack sudo[96396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:42:57 devstack sudo[96396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:57 devstack sudo[96396]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.320s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:57 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:42:57 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Deleted volume successfully. Sep 29 18:42:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f0431f7-a226-4038-85fb-1353c63ed9c1 tempest-VolumesCloneTest-1074633863 None] Lock "cinder-db501419-690d-4b22-b0f2-81a9447ae764-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Acquiring lock "cinder-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Lock "cinder-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Acquiring lock "cinder-quobyte-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Lock "cinder-quobyte-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a22d339-1a10-427d-8c62-c0b6ae9d2d42]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:58 devstack sudo[96692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 Sep 29 18:42:58 devstack sudo[96692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:58 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:42:58 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:58 devstack sudo[96692]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75" returned: 0 in 0.498s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:58 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75 Sep 29 18:42:58 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:58 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.369s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:42:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:42:59 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75" returned: 0 in 0.402s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Lock "cinder-quobyte-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75" released by "delete_volume" :: held 0.999s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:42:59 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Created reservations ['ee65f05f-fd47-4c78-bb30-fbbf0bd1199e', '4622cce9-673c-4288-81c4-8c93ed75a668', 'c4e81a76-062a-4203-93b2-21682ba14b2e', '1099a1e8-9bef-421d-9538-ef4623024b3c'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:42:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:42:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:42:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:42:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:42:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:42:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:42:59 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:42:59 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:42:59 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-36a1b40d-47ac-4641-8014-14bcdc3712ec req-8daf9f27-0792-4522-94df-b496cd7aaca4 tempest-AttachVolumeNegativeTest-1308614236 None] Terminate volume connection completed successfully. Sep 29 18:42:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-36a1b40d-47ac-4641-8014-14bcdc3712ec req-8daf9f27-0792-4522-94df-b496cd7aaca4 tempest-AttachVolumeNegativeTest-1308614236 None] Deleting attachment c907bcb9-6718-48bb-bcb9-d7dd90592ec7. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:42:59 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Sep 29 18:42:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.382s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:42:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:42:59 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Deleted volume successfully. Sep 29 18:42:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f14d470-344f-4d2e-a06b-e4ec20de2831 tempest-VolumesCloneTest-1074633863 None] Lock "cinder-5a0afa91-a9c1-464a-8c3d-c20ecdbc2a75-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Flow 'volume_create_manager' (4c8eab84-6987-4bb5-a02b-edf5721c1f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1860ea1-a591-4a29-a1db-16f794b7f320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1860ea1-a591-4a29-a1db-16f794b7f320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1633273148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01783594-f5e7-4626-b5db-a34d0cbd190c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed07d5e4f3bc41e093a2ee22df64d4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:07Z,use_quota=True,user_id='ff08191567e44afb945c2d08bdb8e361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace8ae0f-b581-435e-8f73-c218a217057e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ace8ae0f-b581-435e-8f73-c218a217057e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99da8776-ac8d-4ceb-8d88-853c24f30f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99da8776-ac8d-4ceb-8d88-853c24f30f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01783594-f5e7-4626-b5db-a34d0cbd190c', 'volume_name': 'volume-01783594-f5e7-4626-b5db-a34d0cbd190c', 'volume_size': 2}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee4611d-b1fc-49b7-abff-8725b444ee54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee4611d-b1fc-49b7-abff-8725b444ee54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aab6200-7baf-4cbc-8aca-7165e80ee389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:06 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Volume 01783594-f5e7-4626-b5db-a34d0cbd190c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01783594-f5e7-4626-b5db-a34d0cbd190c', 'volume_size': 2} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1633273148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01783594-f5e7-4626-b5db-a34d0cbd190c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed07d5e4f3bc41e093a2ee22df64d4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:07Z,use_quota=True,user_id='ff08191567e44afb945c2d08bdb8e361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Creating volume 01783594-f5e7-4626-b5db-a34d0cbd190c {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:43:06 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:43:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-01783594-f5e7-4626-b5db-a34d0cbd190c 2147483648 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:06 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-01783594-f5e7-4626-b5db-a34d0cbd190c 2147483648 Sep 29 18:43:06 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:07 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-01783594-f5e7-4626-b5db-a34d0cbd190c 2147483648" returned: 0 in 0.614s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-01783594-f5e7-4626-b5db-a34d0cbd190c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:07 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-01783594-f5e7-4626-b5db-a34d0cbd190c Sep 29 18:43:07 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:07 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-01783594-f5e7-4626-b5db-a34d0cbd190c" returned: 0 in 0.332s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:43:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7aab6200-7baf-4cbc-8aca-7165e80ee389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01783594-f5e7-4626-b5db-a34d0cbd190c', 'volume_size': 2}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e1bdd2-2d0f-48c2-b11b-3075b8d224cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:08 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Volume volume-01783594-f5e7-4626-b5db-a34d0cbd190c (01783594-f5e7-4626-b5db-a34d0cbd190c): created successfully Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15e1bdd2-2d0f-48c2-b11b-3075b8d224cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Flow 'volume_create_manager' (4c8eab84-6987-4bb5-a02b-edf5721c1f7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:08 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e646b817-1534-433b-9746-c39db3e44aa1 tempest-VolumesCloneNegativeTest-1311423422 None] Created volume successfully. Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Flow 'volume_create_manager' (6b277de7-056b-40eb-ba39-14c5b639085a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d466f130-921f-4aee-a636-7225ef3dc703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d466f130-921f-4aee-a636-7225ef3dc703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-61468847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a144f7d-66a1-4b4d-b859-af1aff384f08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c9544fb72c849de9cb034c61c4c4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:08Z,use_quota=True,user_id='6790b54232ed44a0b360c261d94778ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85afbadb-56f8-44b4-9139-c1c7ad81823f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85afbadb-56f8-44b4-9139-c1c7ad81823f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f1ca06-2fe1-4dd3-b22b-ee1366f56189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3f1ca06-2fe1-4dd3-b22b-ee1366f56189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a144f7d-66a1-4b4d-b859-af1aff384f08', 'volume_name': 'volume-1a144f7d-66a1-4b4d-b859-af1aff384f08', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49650eeb-22a8-4ade-b4de-81d4bba22a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49650eeb-22a8-4ade-b4de-81d4bba22a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aed0ac9-44ae-4fd4-8b80-3fa92385fc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:08 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Volume 1a144f7d-66a1-4b4d-b859-af1aff384f08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a144f7d-66a1-4b4d-b859-af1aff384f08', 'volume_size': 1} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-61468847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a144f7d-66a1-4b4d-b859-af1aff384f08,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='5c9544fb72c849de9cb034c61c4c4b8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:08Z,use_quota=True,user_id='6790b54232ed44a0b360c261d94778ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Creating volume 1a144f7d-66a1-4b4d-b859-af1aff384f08 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:43:08 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1a144f7d-66a1-4b4d-b859-af1aff384f08 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:08 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1a144f7d-66a1-4b4d-b859-af1aff384f08 1073741824 Sep 29 18:43:08 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:08 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1a144f7d-66a1-4b4d-b859-af1aff384f08 1073741824" returned: 0 in 0.544s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1a144f7d-66a1-4b4d-b859-af1aff384f08 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:08 devstack sudo[96788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1a144f7d-66a1-4b4d-b859-af1aff384f08 Sep 29 18:43:08 devstack sudo[96788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:09 devstack sudo[96788]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Acquiring lock "cinder-01783594-f5e7-4626-b5db-a34d0cbd190c-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1a144f7d-66a1-4b4d-b859-af1aff384f08" returned: 0 in 0.563s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3aed0ac9-44ae-4fd4-8b80-3fa92385fc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a144f7d-66a1-4b4d-b859-af1aff384f08', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6b5c6f-cc2e-4d53-8c2a-96ae05dee6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Lock "cinder-01783594-f5e7-4626-b5db-a34d0cbd190c-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Flow 'volume_create_manager' (1bdc37c4-c6a0-4b37-96c3-a0c7ef84a054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191e46dc-c9b7-4177-be70-baed6d66fa50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:09 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Volume volume-1a144f7d-66a1-4b4d-b859-af1aff384f08 (1a144f7d-66a1-4b4d-b859-af1aff384f08): created successfully Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f6b5c6f-cc2e-4d53-8c2a-96ae05dee6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Flow 'volume_create_manager' (6b277de7-056b-40eb-ba39-14c5b639085a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (191e46dc-c9b7-4177-be70-baed6d66fa50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1606163434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321c85b0-e8e4-4be0-9df8-8f11853ceb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7467d7f440047cd9fdc46428193cebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:09Z,use_quota=True,user_id='4db0ce5724a840738b0790088683615a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe70c11-82f6-4c13-824c-2ad85d5f5134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfe70c11-82f6-4c13-824c-2ad85d5f5134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d265cc9-e88e-4ed2-926e-5ce9a0ab33f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.image.glance [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Creating Keystone auth plugin from conf {{(pid=86523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:43:09 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-558b9f08-114e-411c-9cbb-3fb6ffbc5955 req-f1e7edf0-a6e0-4e49-aeb3-7f847961cdb3 tempest-VolumesGetTestJSON-1863117894 None] Created volume successfully. Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Acquiring lock "cinder-quobyte-01783594-f5e7-4626-b5db-a34d0cbd190c" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Lock "cinder-quobyte-01783594-f5e7-4626-b5db-a34d0cbd190c" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e15c92-e852-481f-8406-c9dc7fb7c046]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-01783594-f5e7-4626-b5db-a34d0cbd190c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:09 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-01783594-f5e7-4626-b5db-a34d0cbd190c Sep 29 18:43:09 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d265cc9-e88e-4ed2-926e-5ce9a0ab33f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '321c85b0-e8e4-4be0-9df8-8f11853ceb35', 'volume_name': 'volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05c333c-0709-4031-b2ec-63a5cdd2d4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d05c333c-0709-4031-b2ec-63a5cdd2d4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6568e0a-a0db-4c86-8557-896211ad293a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:10 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Volume 321c85b0-e8e4-4be0-9df8-8f11853ceb35: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Trying to clone 321c85b0-e8e4-4be0-9df8-8f11853ceb35 from image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]). {{(pid=86523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:43:10 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-01783594-f5e7-4626-b5db-a34d0cbd190c" returned: 0 in 0.480s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-01783594-f5e7-4626-b5db-a34d0cbd190c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:10 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-01783594-f5e7-4626-b5db-a34d0cbd190c Sep 29 18:43:10 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:10 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-01783594-f5e7-4626-b5db-a34d0cbd190c" returned: 0 in 0.432s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Lock "cinder-quobyte-01783594-f5e7-4626-b5db-a34d0cbd190c" released by "delete_volume" :: held 0.970s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:43:10 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Image download 20.69 MB at 20.69 MB/s Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Created reservations ['40c9b4b8-9773-43e8-bcd8-541c856582b3', '9d80ad6d-be87-48e3-96bc-c148704406c9', '6fc28bee-fe22-4b78-b404-84f3f2670c05', 'aad2ff99-4d99-4646-89e7-b63f19f838f0'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f351e14-2eda-44cc-bba8-cd44cd4795f1]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:10 devstack sudo[96805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:43:10 devstack sudo[96805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:11 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD Sep 29 18:43:11 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Acquiring lock "cinder-1a144f7d-66a1-4b4d-b859-af1aff384f08-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Lock "cinder-1a144f7d-66a1-4b4d-b859-af1aff384f08-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Acquiring lock "cinder-quobyte-1a144f7d-66a1-4b4d-b859-af1aff384f08" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Lock "cinder-quobyte-1a144f7d-66a1-4b4d-b859-af1aff384f08" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:11 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cccb2cf0-74f6-4f92-8f6a-d2bacd8f7651]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1a144f7d-66a1-4b4d-b859-af1aff384f08 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:11 devstack sudo[96805]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.410s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:11 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:43:11 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Deleted volume successfully. Sep 29 18:43:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f18bd9e5-b890-4e51-92ec-78d6c8a60bac tempest-VolumesCloneNegativeTest-1311423422 None] Lock "cinder-01783594-f5e7-4626-b5db-a34d0cbd190c-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:11 devstack sudo[96817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1a144f7d-66a1-4b4d-b859-af1aff384f08 Sep 29 18:43:11 devstack sudo[96817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:11 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD" returned: 0 in 0.740s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:11 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Temporary image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 is fetched for user 4db0ce5724a840738b0790088683615a. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:43:11 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb94d27d-c5a9-4f21-8ff6-de4068710c0b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:12 devstack sudo[96827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD Sep 29 18:43:12 devstack sudo[96827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:12 devstack sudo[96817]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1a144f7d-66a1-4b4d-b859-af1aff384f08" returned: 0 in 0.725s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1a144f7d-66a1-4b4d-b859-af1aff384f08 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:12 devstack sudo[96836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1a144f7d-66a1-4b4d-b859-af1aff384f08 Sep 29 18:43:12 devstack sudo[96836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:12 devstack sudo[96827]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1606163434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321c85b0-e8e4-4be0-9df8-8f11853ceb35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7467d7f440047cd9fdc46428193cebc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:09Z,use_quota=True,user_id='4db0ce5724a840738b0790088683615a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Creating volume 321c85b0-e8e4-4be0-9df8-8f11853ceb35 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:43:12 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:12 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 1073741824 Sep 29 18:43:12 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:12 devstack sudo[96836]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1a144f7d-66a1-4b4d-b859-af1aff384f08" returned: 0 in 0.327s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Lock "cinder-quobyte-1a144f7d-66a1-4b4d-b859-af1aff384f08" released by "delete_volume" :: held 1.139s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG cinder.quota [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Created reservations ['b3a1ad67-58f5-462c-b88c-c90ef7787a84', '24a0f24f-90f7-4d2a-b062-551c1ffe0c17', '5e4c5d46-93fd-49fd-b457-426ba8c13d99', 'daa72ec5-bf13-406f-ae9b-95a5a5492f09'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:12 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:43:12 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:12 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 1073741824" returned: 0 in 0.658s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:12 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.396s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:12 devstack cinder-volume[86523]: DEBUG cinder.manager [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:43:12 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Deleted volume successfully. Sep 29 18:43:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-5f3ad166-0749-4d33-80ec-863094a4f384 req-c374ce17-cdaf-4fd7-b615-a0516bfe3b44 tempest-VolumesGetTestJSON-1863117894 None] Lock "cinder-1a144f7d-66a1-4b4d-b859-af1aff384f08-delete_volume" released by "delete_volume" :: held 1.863s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:13 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 Sep 29 18:43:13 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:13 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35" returned: 0 in 0.263s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:43:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:13 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Attempting download of 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 ((None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}])) to volume 321c85b0-e8e4-4be0-9df8-8f11853ceb35. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:43:13 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4d63b2-9a9f-4b6c-bd76-de9f23a3f8c4]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_i53c_jc8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:13 devstack sudo[96856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_i53c_jc8 Sep 29 18:43:13 devstack sudo[96856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:13 devstack sudo[96856]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_i53c_jc8" returned: 0 in 0.487s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_i53c_jc8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:13 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_i53c_jc8 Sep 29 18:43:13 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:14 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_i53c_jc8" returned: 1 in 0.613s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_i53c_jc8' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:43:14 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[960f8418-1ac1-4455-813d-66223e9fc92c]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:14 devstack sudo[96880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD Sep 29 18:43:14 devstack sudo[96880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:15 devstack sudo[96880]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD" returned: 0 in 0.524s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:15 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 was qcow2, converting to qcow2 {{(pid=86523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:43:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:15 devstack sudo[96914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 Sep 29 18:43:15 devstack sudo[96914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:18 devstack sudo[96914]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35" returned: 0 in 3.152s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:18 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_chl9vz9wdevstack@QuobyteHD, size 112.00 MB, duration 3.15 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:43:18 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Converted 112.00 MB image at 35.52 MB/s Sep 29 18:43:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:18 devstack sudo[96962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 1G Sep 29 18:43:18 devstack sudo[96962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:18 devstack sudo[96962]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 1G" returned: 0 in 0.489s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:18 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Downloaded image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 ((None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}])) to volume 321c85b0-e8e4-4be0-9df8-8f11853ceb35 successfully. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:43:18 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Temporary image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 for user 4db0ce5724a840738b0790088683615a is deleted. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:43:18 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Marking volume 321c85b0-e8e4-4be0-9df8-8f11853ceb35 as bootable. {{(pid=86523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:43:18 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Copying metadata from image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 to 321c85b0-e8e4-4be0-9df8-8f11853ceb35. {{(pid=86523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:43:18 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Creating volume glance metadata for volume 321c85b0-e8e4-4be0-9df8-8f11853ceb35 backed by image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:43:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6568e0a-a0db-4c86-8557-896211ad293a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964ad3a5-38d7-4a20-a680-247af0fb3103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:18 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Volume volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 (321c85b0-e8e4-4be0-9df8-8f11853ceb35): created successfully Sep 29 18:43:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (964ad3a5-38d7-4a20-a680-247af0fb3103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Flow 'volume_create_manager' (1bdc37c4-c6a0-4b37-96c3-a0c7ef84a054) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:18 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-9ed5836b-c9a7-444e-a860-e0b001f6c4d6 tempest-VolumesImageMetadata-1121796541 None] Created volume successfully. Sep 29 18:43:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Acquiring lock "cinder-321c85b0-e8e4-4be0-9df8-8f11853ceb35-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Lock "cinder-321c85b0-e8e4-4be0-9df8-8f11853ceb35-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Acquiring lock "cinder-quobyte-321c85b0-e8e4-4be0-9df8-8f11853ceb35" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Lock "cinder-quobyte-321c85b0-e8e4-4be0-9df8-8f11853ceb35" acquired by "delete_volume" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:20 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cfd0c9-3cbe-4344-9dce-e3b5ffa31884]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:20 devstack sudo[96969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 Sep 29 18:43:20 devstack sudo[96969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:21 devstack sudo[96969]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35" returned: 0 in 0.487s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:21 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35 Sep 29 18:43:21 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:21 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-321c85b0-e8e4-4be0-9df8-8f11853ceb35" returned: 0 in 0.405s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Lock "cinder-quobyte-321c85b0-e8e4-4be0-9df8-8f11853ceb35" released by "delete_volume" :: held 0.944s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:21 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Created reservations ['46880dcd-215d-46b1-91c7-c1acb0acfdeb', 'a709291f-d6f8-4677-9847-9e3f589d9ee5', 'cebd1e38-dcbf-45a3-93fe-1e8eece96caa', '32ec25bc-6907-47d3-8632-96e12dcbec6a'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:21 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:43:21 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:22 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.356s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:22 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:43:22 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Deleted volume successfully. Sep 29 18:43:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f567a1f0-49a9-4a4a-937a-68ff46db0c1b tempest-VolumesImageMetadata-1121796541 None] Lock "cinder-321c85b0-e8e4-4be0-9df8-8f11853ceb35-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bdd8b1bd-7a05-4910-bbe7-5379143f60b3 tempest-BackendsCapabilitiesAdminTestsJSON-24877478 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9084281921387, 'free_capacity_gb': 1774.9084281921387, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86523) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4870}} Sep 29 18:43:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-203fa2a5-ec29-4c7a-b8eb-b10aa674f113 tempest-BackendsCapabilitiesAdminTestsJSON-24877478 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9084281921387, 'free_capacity_gb': 1774.9084281921387, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86523) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4870}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Flow 'volume_create_manager' (ea3073a0-7a2d-4f18-bab6-7d60f5da2cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03600bf-2623-4da4-a763-30b0d67aa8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03600bf-2623-4da4-a763-30b0d67aa8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1325111140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e688b30b-6c68-4b07-a5d6-accf898efae1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0203c097b094e24b4f6cbeda2477c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:23Z,use_quota=True,user_id='e1bf1d6d49af46d28d32c4b99ba56bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9844e3-c172-41cd-b6f1-a977048d9d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6a9844e3-c172-41cd-b6f1-a977048d9d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0de793e-3dd9-4937-8e2d-c7bbd1191755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0de793e-3dd9-4937-8e2d-c7bbd1191755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e688b30b-6c68-4b07-a5d6-accf898efae1', 'volume_name': 'volume-e688b30b-6c68-4b07-a5d6-accf898efae1', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193fa4f6-b21b-4cf7-b3e9-deb75388f2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193fa4f6-b21b-4cf7-b3e9-deb75388f2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fd11f2-317c-46af-b480-c20fc967723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:23 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Volume e688b30b-6c68-4b07-a5d6-accf898efae1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e688b30b-6c68-4b07-a5d6-accf898efae1', 'volume_size': 1} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1325111140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e688b30b-6c68-4b07-a5d6-accf898efae1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0203c097b094e24b4f6cbeda2477c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:23Z,use_quota=True,user_id='e1bf1d6d49af46d28d32c4b99ba56bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Creating volume e688b30b-6c68-4b07-a5d6-accf898efae1 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:43:23 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e688b30b-6c68-4b07-a5d6-accf898efae1 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:23 devstack sudo[96982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e688b30b-6c68-4b07-a5d6-accf898efae1 1073741824 Sep 29 18:43:23 devstack sudo[96982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:23 devstack sudo[96982]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e688b30b-6c68-4b07-a5d6-accf898efae1 1073741824" returned: 0 in 0.556s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e688b30b-6c68-4b07-a5d6-accf898efae1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:23 devstack sudo[96988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e688b30b-6c68-4b07-a5d6-accf898efae1 Sep 29 18:43:23 devstack sudo[96988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:24 devstack sudo[96988]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e688b30b-6c68-4b07-a5d6-accf898efae1" returned: 0 in 0.318s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:43:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4fd11f2-317c-46af-b480-c20fc967723f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e688b30b-6c68-4b07-a5d6-accf898efae1', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d777025c-265d-40ca-9509-d68a1d89cb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:24 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Volume volume-e688b30b-6c68-4b07-a5d6-accf898efae1 (e688b30b-6c68-4b07-a5d6-accf898efae1): created successfully Sep 29 18:43:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d777025c-265d-40ca-9509-d68a1d89cb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Flow 'volume_create_manager' (ea3073a0-7a2d-4f18-bab6-7d60f5da2cdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:24 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-c878f224-434c-4274-8094-c46b89d91b3f tempest-VolumesListTestJSON-2000223339 None] Created volume successfully. Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Flow 'volume_create_manager' (d1043644-ab60-4bcd-bed4-e7c38d79e5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ed5c57-6702-407d-928b-30c16e73adeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56ed5c57-6702-407d-928b-30c16e73adeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1882719117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d0e4fc-474e-4f3d-904c-1238bc391292,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0203c097b094e24b4f6cbeda2477c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:26Z,use_quota=True,user_id='e1bf1d6d49af46d28d32c4b99ba56bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89878e99-6533-4ff3-80e6-4f09ba4f9e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89878e99-6533-4ff3-80e6-4f09ba4f9e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d262ddb-a78a-44fb-a671-1cc600b135d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d262ddb-a78a-44fb-a671-1cc600b135d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9d0e4fc-474e-4f3d-904c-1238bc391292', 'volume_name': 'volume-f9d0e4fc-474e-4f3d-904c-1238bc391292', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42541340-a92f-4aab-a095-3439e4606a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (42541340-a92f-4aab-a095-3439e4606a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3f8798-244c-4f9d-a042-fb0eb7ce4cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:26 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Volume f9d0e4fc-474e-4f3d-904c-1238bc391292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9d0e4fc-474e-4f3d-904c-1238bc391292', 'volume_size': 1} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1882719117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9d0e4fc-474e-4f3d-904c-1238bc391292,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0203c097b094e24b4f6cbeda2477c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:26Z,use_quota=True,user_id='e1bf1d6d49af46d28d32c4b99ba56bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Creating volume f9d0e4fc-474e-4f3d-904c-1238bc391292 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:43:26 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9d0e4fc-474e-4f3d-904c-1238bc391292 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:26 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9d0e4fc-474e-4f3d-904c-1238bc391292 1073741824 Sep 29 18:43:26 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:26 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9d0e4fc-474e-4f3d-904c-1238bc391292 1073741824" returned: 0 in 0.665s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9d0e4fc-474e-4f3d-904c-1238bc391292 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:27 devstack sudo[96997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9d0e4fc-474e-4f3d-904c-1238bc391292 Sep 29 18:43:27 devstack sudo[96997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:27 devstack sudo[96997]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9d0e4fc-474e-4f3d-904c-1238bc391292" returned: 0 in 0.347s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:43:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b3f8798-244c-4f9d-a042-fb0eb7ce4cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9d0e4fc-474e-4f3d-904c-1238bc391292', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af88cb44-4f37-445c-bffc-819e7d016e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:27 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Volume volume-f9d0e4fc-474e-4f3d-904c-1238bc391292 (f9d0e4fc-474e-4f3d-904c-1238bc391292): created successfully Sep 29 18:43:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af88cb44-4f37-445c-bffc-819e7d016e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Flow 'volume_create_manager' (d1043644-ab60-4bcd-bed4-e7c38d79e5d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4429dadc-e6db-47e6-8195-54b9c872522e tempest-VolumesListTestJSON-2000223339 None] Created volume successfully. Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Flow 'volume_create_manager' (6f066345-ede2-4eb2-9e79-73a73cea23d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb06438-9d97-47a6-8a20-c87c9dbc58af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb06438-9d97-47a6-8a20-c87c9dbc58af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-660613862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70fcc4d-5a01-489e-9a86-887d22cce0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2ace885c0745a6a66f288584f471fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:28Z,use_quota=True,user_id='55a42170994b4e97b3b617e1e83173f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581fe9a8-f5cf-4edf-aec7-9cad5960f9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (581fe9a8-f5cf-4edf-aec7-9cad5960f9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f177c7f-d81f-41b3-8626-7d2cb9f25cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f177c7f-d81f-41b3-8626-7d2cb9f25cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f70fcc4d-5a01-489e-9a86-887d22cce0e9', 'volume_name': 'volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfec8ad5-b168-4cec-946c-ca72ae3f4630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfec8ad5-b168-4cec-946c-ca72ae3f4630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9b2268-d4da-48ad-92ae-4f58050a3330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:28 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Volume f70fcc4d-5a01-489e-9a86-887d22cce0e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9', 'volume_size': 1} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-660613862',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f70fcc4d-5a01-489e-9a86-887d22cce0e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc2ace885c0745a6a66f288584f471fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:28Z,use_quota=True,user_id='55a42170994b4e97b3b617e1e83173f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Creating volume f70fcc4d-5a01-489e-9a86-887d22cce0e9 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:43:28 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:43:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:28 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9 1073741824 Sep 29 18:43:28 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Flow 'volume_create_manager' (81cf4640-7e92-4d13-a766-afe98002795e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c413db1e-fdeb-493f-945f-7136005315c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c413db1e-fdeb-493f-945f-7136005315c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-133066189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912e53bc-8ca6-4d27-bfe6-97c9a1148d1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0203c097b094e24b4f6cbeda2477c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:29Z,use_quota=True,user_id='e1bf1d6d49af46d28d32c4b99ba56bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afda0655-5518-42ae-a700-ba048bb2ce9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afda0655-5518-42ae-a700-ba048bb2ce9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7a2fd6-80a7-44e0-8d5b-35b3f56b50c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa7a2fd6-80a7-44e0-8d5b-35b3f56b50c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912e53bc-8ca6-4d27-bfe6-97c9a1148d1b', 'volume_name': 'volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e4ed6c-cc36-4b91-ba86-9a49aab620b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72e4ed6c-cc36-4b91-ba86-9a49aab620b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5fbf05-bef9-42f0-b70b-8e4187d9870c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:29 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Volume 912e53bc-8ca6-4d27-bfe6-97c9a1148d1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b', 'volume_size': 1} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:29 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9 1073741824" returned: 0 in 0.652s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:29 devstack sudo[97006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9 Sep 29 18:43:29 devstack sudo[97006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:29 devstack sudo[97006]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9" returned: 0 in 0.321s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.408s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-133066189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912e53bc-8ca6-4d27-bfe6-97c9a1148d1b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a0203c097b094e24b4f6cbeda2477c0e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:29Z,use_quota=True,user_id='e1bf1d6d49af46d28d32c4b99ba56bf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Creating volume 912e53bc-8ca6-4d27-bfe6-97c9a1148d1b {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:43:29 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:29 devstack sudo[97009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b 1073741824 Sep 29 18:43:29 devstack sudo[97009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9b2268-d4da-48ad-92ae-4f58050a3330) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66908eb-eab6-4a53-8c2b-a2cd13af7ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:29 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Volume volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9 (f70fcc4d-5a01-489e-9a86-887d22cce0e9): created successfully Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d66908eb-eab6-4a53-8c2b-a2cd13af7ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Flow 'volume_create_manager' (6f066345-ede2-4eb2-9e79-73a73cea23d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:29 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-175ed23a-7400-46fc-97ae-48f809e90191 tempest-VolumesMetadataTest-1137963533 None] Created volume successfully. Sep 29 18:43:30 devstack sudo[97009]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b 1073741824" returned: 0 in 0.573s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-83928c5b-d976-4b24-87db-853cc51982dd tempest-GroupSnapshotsTest-1650590574 None] Group tempest-GroupSnapshotsTest-Group-1309144519: creating Sep 29 18:43:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-83928c5b-d976-4b24-87db-853cc51982dd tempest-GroupSnapshotsTest-1650590574 None] Group tempest-GroupSnapshotsTest-Group-1309144519: created successfully Sep 29 18:43:30 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b Sep 29 18:43:30 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-83928c5b-d976-4b24-87db-853cc51982dd tempest-GroupSnapshotsTest-1650590574 None] Create group completed successfully. Sep 29 18:43:30 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b" returned: 0 in 0.284s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] <== create_volume: return (922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:43:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae5fbf05-bef9-42f0-b70b-8e4187d9870c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5015edc-e224-4781-a75c-c7db2e26c288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:30 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Volume volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b (912e53bc-8ca6-4d27-bfe6-97c9a1148d1b): created successfully Sep 29 18:43:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5015edc-e224-4781-a75c-c7db2e26c288) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Flow 'volume_create_manager' (81cf4640-7e92-4d13-a766-afe98002795e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e9b6ab7a-a0f4-4ddd-b41c-0665e80daaba tempest-VolumesListTestJSON-2000223339 None] Created volume successfully. Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Acquiring lock "cinder-f70fcc4d-5a01-489e-9a86-887d22cce0e9-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Lock "cinder-f70fcc4d-5a01-489e-9a86-887d22cce0e9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Acquiring lock "cinder-quobyte-f70fcc4d-5a01-489e-9a86-887d22cce0e9" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Lock "cinder-quobyte-f70fcc4d-5a01-489e-9a86-887d22cce0e9" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4277fc81-55df-4a91-967c-e8f636de3be8]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:31 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9 Sep 29 18:43:31 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:31 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9" returned: 0 in 0.443s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:31 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9 Sep 29 18:43:31 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Flow 'volume_create_manager' (36833922-d10a-4c53-8ed0-80943ff99413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4593dbf5-5da2-418a-915a-f165dafefb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4593dbf5-5da2-418a-915a-f165dafefb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-301883331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c90aa3a7-2eb6-4708-b127-4a240f059e83,host='devstack@QuobyteHD#QuobyteHD',id=92950ec3-8c1c-47e4-b698-6569877a36b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1a128b13f54d9a87bbb11f295ae88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:32Z,use_quota=True,user_id='bcdbe94978e84df5b949f39b19aae8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543be860-90ae-4ce9-bbc9-bbdff77ea047),volume_type_id=543be860-90ae-4ce9-bbc9-bbdff77ea047)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07b5ccc-ed4a-4c11-b16a-f127f02715de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d07b5ccc-ed4a-4c11-b16a-f127f02715de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8644c6f-d0f9-4f60-8316-f5efb91853ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8644c6f-d0f9-4f60-8316-f5efb91853ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92950ec3-8c1c-47e4-b698-6569877a36b0', 'volume_name': 'volume-92950ec3-8c1c-47e4-b698-6569877a36b0', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2526c5ac-890e-4b7a-888e-c11a85ed57b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2526c5ac-890e-4b7a-888e-c11a85ed57b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af91edf9-6dfb-4ae4-a4c7-b3a53a2a22f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:32 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Volume 92950ec3-8c1c-47e4-b698-6569877a36b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92950ec3-8c1c-47e4-b698-6569877a36b0', 'volume_size': 1} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c90aa3a7-2eb6-4708-b127-4a240f059e83,created_at=2026-09-29T16:43:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-301883331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c90aa3a7-2eb6-4708-b127-4a240f059e83,host='devstack@QuobyteHD#QuobyteHD',id=92950ec3-8c1c-47e4-b698-6569877a36b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1a128b13f54d9a87bbb11f295ae88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:32Z,use_quota=True,user_id='bcdbe94978e84df5b949f39b19aae8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(543be860-90ae-4ce9-bbc9-bbdff77ea047),volume_type_id=543be860-90ae-4ce9-bbc9-bbdff77ea047)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Creating volume 92950ec3-8c1c-47e4-b698-6569877a36b0 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:43:32 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:32 devstack sudo[97057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 1073741824 Sep 29 18:43:32 devstack sudo[97057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:32 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f70fcc4d-5a01-489e-9a86-887d22cce0e9" returned: 0 in 0.312s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Lock "cinder-quobyte-f70fcc4d-5a01-489e-9a86-887d22cce0e9" released by "delete_volume" :: held 0.816s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Created reservations ['69289757-f5ab-4da6-aaad-2916708344cc', '21ccd610-5ee8-4880-afad-332b3603cf0f', '16da956a-d3ae-4e95-b55f-a243ec1d8950', '3a49ce5a-9cd5-40cb-802d-74fd18129d81'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:32 devstack sudo[97063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:43:32 devstack sudo[97063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:32 devstack sudo[97057]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 1073741824" returned: 0 in 0.529s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:32 devstack sudo[97063]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.289s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:43:32 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Deleted volume successfully. Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-05926f76-1f94-4137-a653-5f9510bc66e4 tempest-VolumesMetadataTest-1137963533 None] Lock "cinder-f70fcc4d-5a01-489e-9a86-887d22cce0e9-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:32 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 Sep 29 18:43:32 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:32 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0" returned: 0 in 0.287s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af91edf9-6dfb-4ae4-a4c7-b3a53a2a22f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92950ec3-8c1c-47e4-b698-6569877a36b0', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197977b3-8345-4f7c-880b-8cb2f9577510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:32 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Volume volume-92950ec3-8c1c-47e4-b698-6569877a36b0 (92950ec3-8c1c-47e4-b698-6569877a36b0): created successfully Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (197977b3-8345-4f7c-880b-8cb2f9577510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Flow 'volume_create_manager' (36833922-d10a-4c53-8ed0-80943ff99413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:32 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e251dff7-a376-456a-a09b-eb61021b0cd0 tempest-GroupSnapshotsTest-1650590574 None] Created volume successfully. Sep 29 18:43:33 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] GroupSnapshot 5ae471f4-f484-4366-877f-99fb860c44b5: creating. Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "cinder-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] Group snapshot 5ae471f4-f484-4366-877f-99fb860c44b5: creating. {{(pid=86523) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4215}} Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Lock "cinder-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] Creating offline snapshot 2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f of volume 92950ec3-8c1c-47e4-b698-6569877a36b0 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[272d8d79-695b-4ce0-af93-fee2cc9cc0c0]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "cinder-quobyte-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Lock "cinder-quobyte-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b" acquired by "delete_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d181fe-9d2c-4a12-a0a0-13aa5f278dc2]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:33 devstack sudo[97072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 Sep 29 18:43:33 devstack sudo[97072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:33 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b Sep 29 18:43:33 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:33 devstack sudo[97072]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0" returned: 0 in 0.418s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:33 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f 1G Sep 29 18:43:33 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:33 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b" returned: 0 in 0.401s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:34 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b Sep 29 18:43:34 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:34 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b" returned: 0 in 0.302s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Lock "cinder-quobyte-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b" released by "delete_volume" :: held 0.762s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:34 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f 1G" returned: 0 in 0.471s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950ec3-8c1c-47e4-b698-6569877a36b0 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Created reservations ['8ccead1c-c3ce-4da2-a973-43b10b6b421f', '17a4c9df-9f63-4d14-9a7e-7f11b205ab10', 'c988c68f-2f09-419d-87ca-fcf31f626ed2', '59fb3a61-1a68-45b1-b245-78df210dc10f'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:34 devstack sudo[97093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950ec3-8c1c-47e4-b698-6569877a36b0 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f Sep 29 18:43:34 devstack sudo[97093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:34 devstack sudo[97095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:43:34 devstack sudo[97095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "cinder-f9d0e4fc-474e-4f3d-904c-1238bc391292-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Lock "cinder-f9d0e4fc-474e-4f3d-904c-1238bc391292-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "cinder-quobyte-f9d0e4fc-474e-4f3d-904c-1238bc391292" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Lock "cinder-quobyte-f9d0e4fc-474e-4f3d-904c-1238bc391292" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:34 devstack sudo[97093]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe61e13-e779-4b30-aa7c-95359e010246]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9d0e4fc-474e-4f3d-904c-1238bc391292 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-92950ec3-8c1c-47e4-b698-6569877a36b0 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f" returned: 0 in 0.439s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:34 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:34 devstack sudo[97095]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.339s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:43:34 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f Sep 29 18:43:34 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:34 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Deleted volume successfully. Sep 29 18:43:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d8ae8407-71d5-4cb9-a985-ec217be3ec0a tempest-VolumesListTestJSON-2000223339 None] Lock "cinder-912e53bc-8ca6-4d27-bfe6-97c9a1148d1b-delete_volume" released by "delete_volume" :: held 1.456s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:34 devstack sudo[97102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9d0e4fc-474e-4f3d-904c-1238bc391292 Sep 29 18:43:34 devstack sudo[97102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:35 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f" returned: 0 in 0.281s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:35 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.info Sep 29 18:43:35 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:35 devstack sudo[97102]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9d0e4fc-474e-4f3d-904c-1238bc391292" returned: 0 in 0.407s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9d0e4fc-474e-4f3d-904c-1238bc391292 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:35 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9d0e4fc-474e-4f3d-904c-1238bc391292 Sep 29 18:43:35 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:35 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.info" returned: 0 in 0.299s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:35 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:35 devstack sudo[97116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.info Sep 29 18:43:35 devstack sudo[97116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:35 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9d0e4fc-474e-4f3d-904c-1238bc391292" returned: 0 in 0.300s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Lock "cinder-quobyte-f9d0e4fc-474e-4f3d-904c-1238bc391292" released by "delete_volume" :: held 0.775s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Created reservations ['6467998d-aff5-450c-b5c4-ef018a809d0f', 'b09b1aa8-e7c6-4748-bd8a-8d1739df819f', '43ba1da9-1cfa-41b2-b74a-79c962396629', '31d1f670-5fcf-4fa6-827d-f8e47a7af45e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:35 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:43:35 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:35 devstack sudo[97116]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.info" returned: 0 in 0.306s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.312s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:35 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ebd5ea43-55d2-4768-902a-6c096edd0f43 tempest-GroupSnapshotsTest-1650590574 None] group_snapshot 5ae471f4-f484-4366-877f-99fb860c44b5: created successfully Sep 29 18:43:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "cinder-e688b30b-6c68-4b07-a5d6-accf898efae1-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:35 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.290s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Lock "cinder-e688b30b-6c68-4b07-a5d6-accf898efae1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:36 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Deleted volume successfully. Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a7bef6e8-4956-4ea3-be8e-de95d9fa647c tempest-VolumesListTestJSON-2000223339 None] Lock "cinder-f9d0e4fc-474e-4f3d-904c-1238bc391292-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "cinder-quobyte-e688b30b-6c68-4b07-a5d6-accf898efae1" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Lock "cinder-quobyte-e688b30b-6c68-4b07-a5d6-accf898efae1" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe63ee9-c807-40b4-9a2b-b2dbda1aaac5]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e688b30b-6c68-4b07-a5d6-accf898efae1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:36 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e688b30b-6c68-4b07-a5d6-accf898efae1 Sep 29 18:43:36 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:36 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e688b30b-6c68-4b07-a5d6-accf898efae1" returned: 0 in 0.386s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e688b30b-6c68-4b07-a5d6-accf898efae1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:36 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e688b30b-6c68-4b07-a5d6-accf898efae1 Sep 29 18:43:36 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:36 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e688b30b-6c68-4b07-a5d6-accf898efae1" returned: 0 in 0.272s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Lock "cinder-quobyte-e688b30b-6c68-4b07-a5d6-accf898efae1" released by "delete_volume" :: held 0.708s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Created reservations ['d843a4ea-b99f-42f5-a86e-f076409fce7f', 'e012adab-cf82-475b-9bfd-7864b3647bde', '2d3ca379-e5db-4504-a382-8711a9d30d4f', 'ca3a37b2-e5d4-40e3-915a-b5ceac445830'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:36 devstack sudo[97131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:43:36 devstack sudo[97131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:37 devstack sudo[97131]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.324s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:43:37 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Deleted volume successfully. Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-751be938-c2df-4903-823c-b1cb7236de0b tempest-VolumesListTestJSON-2000223339 None] Lock "cinder-e688b30b-6c68-4b07-a5d6-accf898efae1-delete_volume" released by "delete_volume" :: held 1.282s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f-20a230fd-28ea-46e0-a6ce-8e59715aa3e8" by "_create_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f-20a230fd-28ea-46e0-a6ce-8e59715aa3e8" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Creating volume 20a230fd-28ea-46e0-a6ce-8e59715aa3e8 from snapshot 2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f {{(pid=86523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-20a230fd-28ea-46e0-a6ce-8e59715aa3e8" by "_copy_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-20a230fd-28ea-46e0-a6ce-8e59715aa3e8" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] snapshot: 2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f, volume: 20a230fd-28ea-46e0-a6ce-8e59715aa3e8, {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[05769aa2-2eb6-4fc2-b42f-a31565072ec2]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:37 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f Sep 29 18:43:37 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:38 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f" returned: 0 in 0.511s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950ec3-8c1c-47e4-b698-6569877a36b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:43:38 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ed113f-7d92-4e2a-981f-27121ae077f3]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:38 devstack sudo[97139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 Sep 29 18:43:38 devstack sudo[97139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:38 devstack sudo[97139]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0" returned: 0 in 0.473s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:43:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Creating direct copy from snapshot {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:43:38 devstack cinder-volume[86523]: DEBUG cinder.utils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Path /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8 not found in is_blk_device check {{(pid=86523) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:43:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:38 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8 Sep 29 18:43:38 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:39 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:43:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Flow 'volume_create_manager' (fc82fe8e-830e-4889-a7df-730c6a0b9e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80df09d7-d6e8-46dd-8c36-0c3de39d4d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80df09d7-d6e8-46dd-8c36-0c3de39d4d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-899465164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cc7799-47c6-44ee-b259-3961d402bd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77e4e9ccf324f24a543911f9ebb1645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:39Z,use_quota=True,user_id='daf9b4ad62c347ed84c06522487eb3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647d4707-7366-42cd-bfba-5c8e54172d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647d4707-7366-42cd-bfba-5c8e54172d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1b67c4-7b2b-4370-91c2-391589a4ac43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1b67c4-7b2b-4370-91c2-391589a4ac43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4cc7799-47c6-44ee-b259-3961d402bd8d', 'volume_name': 'volume-c4cc7799-47c6-44ee-b259-3961d402bd8d', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d88713-36a1-4269-9e4d-90af14389222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4d88713-36a1-4269-9e4d-90af14389222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fbba76-f84c-4e40-b442-783380cc0180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:39 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Volume c4cc7799-47c6-44ee-b259-3961d402bd8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4cc7799-47c6-44ee-b259-3961d402bd8d', 'volume_size': 1} Sep 29 18:43:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:41 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:43:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Flow 'volume_create_manager' (5d0e2e10-542b-4946-9f33-200afd20007c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55603b0d-b20d-42d5-a822-f58845307444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55603b0d-b20d-42d5-a822-f58845307444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1080663305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1290148-eed8-4217-a349-6c3b5cfae7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c606eb586e8e4aef82c94f12f7ce7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:42Z,use_quota=True,user_id='2e9bebf527b74793ad4b1aef9e3759c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca59a67b-f929-4f2f-9525-65d43a6bc42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca59a67b-f929-4f2f-9525-65d43a6bc42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad02b3fd-a25d-4b49-9e51-0b5e634657b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad02b3fd-a25d-4b49-9e51-0b5e634657b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1290148-eed8-4217-a349-6c3b5cfae7ef', 'volume_name': 'volume-a1290148-eed8-4217-a349-6c3b5cfae7ef', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cf43e8-f0f5-4e38-b095-bc4fde3ec5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4cf43e8-f0f5-4e38-b095-bc4fde3ec5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02490eb-b438-45a2-8030-1f32f860793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:42 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Volume a1290148-eed8-4217-a349-6c3b5cfae7ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1290148-eed8-4217-a349-6c3b5cfae7ef', 'volume_size': 1} Sep 29 18:43:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:46 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8" returned: 0 in 8.080s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0, size 1024.00 MB, duration 8.08 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:43:46 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Converted 1024.00 MB image at 126.72 MB/s Sep 29 18:43:46 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:46 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8 Sep 29 18:43:46 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:46 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8" returned: 0 in 0.246s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-20a230fd-28ea-46e0-a6ce-8e59715aa3e8" released by "_copy_volume_from_snapshot" :: held 9.442s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f-20a230fd-28ea-46e0-a6ce-8e59715aa3e8" released by "_create_volume_from_snapshot" :: held 9.528s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.544s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.809s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-899465164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4cc7799-47c6-44ee-b259-3961d402bd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77e4e9ccf324f24a543911f9ebb1645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:39Z,use_quota=True,user_id='daf9b4ad62c347ed84c06522487eb3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Creating volume c4cc7799-47c6-44ee-b259-3961d402bd8d {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:43:46 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:43:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4cc7799-47c6-44ee-b259-3961d402bd8d 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:47 devstack sudo[97164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4cc7799-47c6-44ee-b259-3961d402bd8d 1073741824 Sep 29 18:43:47 devstack sudo[97164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:47 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-545aad33-3eef-433b-b21d-bec920327bc4 tempest-GroupSnapshotsTest-1650590574 None] Create group from source-snapshot-5ae471f4-f484-4366-877f-99fb860c44b5 completed successfully. Sep 29 18:43:47 devstack sudo[97164]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4cc7799-47c6-44ee-b259-3961d402bd8d 1073741824" returned: 0 in 0.515s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4cc7799-47c6-44ee-b259-3961d402bd8d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:47 devstack sudo[97170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4cc7799-47c6-44ee-b259-3961d402bd8d Sep 29 18:43:47 devstack sudo[97170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:47 devstack sudo[97170]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4cc7799-47c6-44ee-b259-3961d402bd8d" returned: 0 in 0.246s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.698s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1080663305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1290148-eed8-4217-a349-6c3b5cfae7ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c606eb586e8e4aef82c94f12f7ce7f2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:42Z,use_quota=True,user_id='2e9bebf527b74793ad4b1aef9e3759c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Creating volume a1290148-eed8-4217-a349-6c3b5cfae7ef {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:43:47 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a1290148-eed8-4217-a349-6c3b5cfae7ef 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50fbba76-f84c-4e40-b442-783380cc0180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4cc7799-47c6-44ee-b259-3961d402bd8d', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:47 devstack sudo[97173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a1290148-eed8-4217-a349-6c3b5cfae7ef 1073741824 Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab42b29-edbe-49ec-a657-af17c5cf56bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:47 devstack sudo[97173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:47 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Volume volume-c4cc7799-47c6-44ee-b259-3961d402bd8d (c4cc7799-47c6-44ee-b259-3961d402bd8d): created successfully Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ab42b29-edbe-49ec-a657-af17c5cf56bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Flow 'volume_create_manager' (fc82fe8e-830e-4889-a7df-730c6a0b9e36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:47 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7e80089b-78dd-4780-a84d-e76db2fc9ddc tempest-VolumesTransfersV355Test-160002666 None] Created volume successfully. Sep 29 18:43:48 devstack sudo[97173]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a1290148-eed8-4217-a349-6c3b5cfae7ef 1073741824" returned: 0 in 0.609s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a1290148-eed8-4217-a349-6c3b5cfae7ef {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:48 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a1290148-eed8-4217-a349-6c3b5cfae7ef Sep 29 18:43:48 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-20a230fd-28ea-46e0-a6ce-8e59715aa3e8" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-20a230fd-28ea-46e0-a6ce-8e59715aa3e8" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:48 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2541c3c8-efa7-409c-ba5d-441baf7cacec]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:48 devstack sudo[97181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8 Sep 29 18:43:48 devstack sudo[97181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:48 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a1290148-eed8-4217-a349-6c3b5cfae7ef" returned: 0 in 0.429s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:43:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a02490eb-b438-45a2-8030-1f32f860793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1290148-eed8-4217-a349-6c3b5cfae7ef', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c9c3e2-3e83-42bd-b613-8a470b381171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:48 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Volume volume-a1290148-eed8-4217-a349-6c3b5cfae7ef (a1290148-eed8-4217-a349-6c3b5cfae7ef): created successfully Sep 29 18:43:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1c9c3e2-3e83-42bd-b613-8a470b381171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Flow 'volume_create_manager' (5d0e2e10-542b-4946-9f33-200afd20007c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:49 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f5087142-d5e1-47b6-8246-a9a37233be11 tempest-AttachVolumeNegativeTest-1308614236 None] Created volume successfully. Sep 29 18:43:49 devstack sudo[97181]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8" returned: 0 in 0.539s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:49 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8 Sep 29 18:43:49 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:49 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-20a230fd-28ea-46e0-a6ce-8e59715aa3e8" returned: 0 in 0.420s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:49 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-20a230fd-28ea-46e0-a6ce-8e59715aa3e8" released by "delete_volume" :: held 1.040s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:49 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Created reservations ['41da79ff-3f5c-4beb-a625-d11f023d1952'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:49 devstack cinder-volume[86523]: WARNING cinder.quota [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1911130067 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1911130067, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:43:49 devstack cinder-volume[86523]: WARNING cinder.quota [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1911130067 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1911130067, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:43:49 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Created reservations ['aeca021f-7539-4149-a731-09b8d9faf100', 'e2f486d1-1eca-4683-a9cd-49c14fdad7a8', 'daf0ebca-b511-4904-b664-2af5c262d580', 'ffd667b2-a905-4065-bde5-1bbb216e1cec'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:50 devstack sudo[97202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:43:50 devstack sudo[97202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:50 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-bd319d98-3634-423e-adff-14f183ac13ba tempest-VolumesTransfersV355Test-556627583 None] Transfer volume completed successfully. Sep 29 18:43:50 devstack sudo[97202]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.342s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:43:50 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-aa11af37-8b69-4554-a0f2-334caa1f519e tempest-GroupSnapshotsTest-1650590574 None] Delete group completed successfully. Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-c4889b1b-1b00-4a11-8e36-df06eb552236 req-66d69d9b-226d-46b9-8277-6ce0519e53b8 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-c4889b1b-1b00-4a11-8e36-df06eb552236 req-66d69d9b-226d-46b9-8277-6ce0519e53b8 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-c4889b1b-1b00-4a11-8e36-df06eb552236 req-66d69d9b-226d-46b9-8277-6ce0519e53b8 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-c4889b1b-1b00-4a11-8e36-df06eb552236 req-66d69d9b-226d-46b9-8277-6ce0519e53b8 tempest-AttachVolumeNegativeTest-1308614236 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-a1290148-eed8-4217-a349-6c3b5cfae7ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6031501e-28a5-4853-b5b2-5e374ce8e969', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:43:50 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-c4889b1b-1b00-4a11-8e36-df06eb552236 req-66d69d9b-226d-46b9-8277-6ce0519e53b8 tempest-AttachVolumeNegativeTest-1308614236 None] attachment_update completed successfully. Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Acquiring lock "cinder-c4cc7799-47c6-44ee-b259-3961d402bd8d-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Lock "cinder-c4cc7799-47c6-44ee-b259-3961d402bd8d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Acquiring lock "cinder-quobyte-c4cc7799-47c6-44ee-b259-3961d402bd8d" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Lock "cinder-quobyte-c4cc7799-47c6-44ee-b259-3961d402bd8d" acquired by "delete_volume" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:51 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[482ad32b-ce31-4729-a26e-80205d27a34e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4cc7799-47c6-44ee-b259-3961d402bd8d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:51 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] group_snapshot 5ae471f4-f484-4366-877f-99fb860c44b5: deleting Sep 29 18:43:51 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4cc7799-47c6-44ee-b259-3961d402bd8d Sep 29 18:43:51 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] group_snapshot 5ae471f4-f484-4366-877f-99fb860c44b5: deleting {{(pid=86523) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4390}} Sep 29 18:43:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-92950ec3-8c1c-47e4-b698-6569877a36b0" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-92950ec3-8c1c-47e4-b698-6569877a36b0" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Deleting offline snapshot 2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f of volume 92950ec3-8c1c-47e4-b698-6569877a36b0 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:43:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] snapshot_file for this snap is: volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:43:51 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b54c14-0284-4dc6-9fbf-cc94e5accd23]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:51 devstack sudo[97666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f Sep 29 18:43:51 devstack sudo[97666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:51 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4cc7799-47c6-44ee-b259-3961d402bd8d" returned: 0 in 0.732s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4cc7799-47c6-44ee-b259-3961d402bd8d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:51 devstack sudo[97674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4cc7799-47c6-44ee-b259-3961d402bd8d Sep 29 18:43:51 devstack sudo[97674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:52 devstack sudo[97666]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f" returned: 0 in 0.704s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-92950ec3-8c1c-47e4-b698-6569877a36b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:43:52 devstack sudo[97674]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4cc7799-47c6-44ee-b259-3961d402bd8d" returned: 0 in 0.469s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d300bf-d806-44da-ace1-38fdf80842a2]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Lock "cinder-quobyte-c4cc7799-47c6-44ee-b259-3961d402bd8d" released by "delete_volume" :: held 1.298s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=129,cinder:UPDATE=158,cinder:INSERT=39,cinder:DELETE=14 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Created reservations ['80282054-4f90-4922-a086-5a2e4d58fa2f', 'dd9121be-b134-4ba6-aabf-3d948ac7e621', 'ed4a8cec-343f-4762-8359-7ce07ecb9a69', 'f543dd71-649a-4d54-b78b-34e3744fd0b0'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:52 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 Sep 29 18:43:52 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:52 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:43:52 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:52 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.319s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:43:52 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Deleted volume successfully. Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-30c12339-337e-4a44-bee6-803c4f8ab5ea tempest-VolumesTransfersV355Test-115525641 None] Lock "cinder-c4cc7799-47c6-44ee-b259-3961d402bd8d-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:52 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0" returned: 0 in 0.688s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:52 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f Sep 29 18:43:52 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:53 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f" returned: 0 in 0.506s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:53 devstack sudo[97699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f Sep 29 18:43:53 devstack sudo[97699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:53 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-5d2b4079-1fee-4fbd-87ab-b53100fbce34 req-77d7d28e-df9e-4a26-bbe2-340fc27090a3 tempest-AttachVolumeNegativeTest-1308614236 None] Terminate volume connection completed successfully. Sep 29 18:43:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-5d2b4079-1fee-4fbd-87ab-b53100fbce34 req-77d7d28e-df9e-4a26-bbe2-340fc27090a3 tempest-AttachVolumeNegativeTest-1308614236 None] Deleting attachment 6031501e-28a5-4853-b5b2-5e374ce8e969. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:43:53 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=157,cinder:SELECT=135,cinder:DELETE=10,cinder:INSERT=45 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:43:53 devstack sudo[97699]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0.2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f" returned: 0 in 0.395s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:53 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:43:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Flow 'volume_create_manager' (ea4208a8-58c1-4b2a-af11-64b4acc35aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61739a9d-b4f9-4ff2-a125-183095c02f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-2e7da695-9b9f-406f-b8a2-3ee2f35d5d2f" released by "_delete_snapshot" :: held 2.542s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61739a9d-b4f9-4ff2-a125-183095c02f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-228348863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3f34c7-0bb8-466a-b962-0721f0b4bcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77e4e9ccf324f24a543911f9ebb1645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:54Z,use_quota=True,user_id='daf9b4ad62c347ed84c06522487eb3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c55d12d-4b11-48bc-b2e2-61b74676b1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c55d12d-4b11-48bc-b2e2-61b74676b1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09133976-3842-4459-b953-8189a94d878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09133976-3842-4459-b953-8189a94d878a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd3f34c7-0bb8-466a-b962-0721f0b4bcb5', 'volume_name': 'volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af27bf07-9c4d-4a80-9ffe-e274f0c0de94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af27bf07-9c4d-4a80-9ffe-e274f0c0de94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3485e957-0d6b-4710-8101-d7bcd9dc881b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:54 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Volume dd3f34c7-0bb8-466a-b962-0721f0b4bcb5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5', 'volume_size': 1} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-228348863',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd3f34c7-0bb8-466a-b962-0721f0b4bcb5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d77e4e9ccf324f24a543911f9ebb1645',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:54Z,use_quota=True,user_id='daf9b4ad62c347ed84c06522487eb3c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Creating volume dd3f34c7-0bb8-466a-b962-0721f0b4bcb5 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:43:54 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-92950ec3-8c1c-47e4-b698-6569877a36b0" released by "delete_snapshot" :: held 2.699s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:54 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5 1073741824 Sep 29 18:43:54 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:54 devstack cinder-volume[86523]: WARNING cinder.quota [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1911130067 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1911130067, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] Created reservations ['ba84e6c1-7a86-4e07-b963-f65cabbd2c65', 'c72f883a-9b46-4417-80a5-34bddd51b3a3', 'af9c06e0-44e3-414a-a24e-dc23fdb8a2d3', 'cb7e921b-5796-4e09-a9a0-03d79ef49e2d'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:54 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7d3fba50-59bc-4c5a-870d-a60cb229d1dd tempest-GroupSnapshotsTest-1650590574 None] group_snapshot 5ae471f4-f484-4366-877f-99fb860c44b5: deleted successfully Sep 29 18:43:54 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5 1073741824" returned: 0 in 0.642s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:54 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5 Sep 29 18:43:54 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:55 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5" returned: 0 in 0.405s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:55 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:43:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.104s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:55 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3485e957-0d6b-4710-8101-d7bcd9dc881b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:55 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d496aaf-3487-44fe-8bf8-8347edd24f3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:55 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Volume volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5 (dd3f34c7-0bb8-466a-b962-0721f0b4bcb5): created successfully Sep 29 18:43:55 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d496aaf-3487-44fe-8bf8-8347edd24f3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:55 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Flow 'volume_create_manager' (ea4208a8-58c1-4b2a-af11-64b4acc35aec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:55 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-0fcda548-3427-48a2-a1f2-f3ff5703a1ce tempest-VolumesTransfersV355Test-160002666 None] Created volume successfully. Sep 29 18:43:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-92950ec3-8c1c-47e4-b698-6569877a36b0" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-92950ec3-8c1c-47e4-b698-6569877a36b0" acquired by "delete_volume" :: waited 0.041s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:55 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfd1c13-e46e-4f3b-a84d-014a5fd1ab02]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:55 devstack sudo[97759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 Sep 29 18:43:55 devstack sudo[97759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:56 devstack sudo[97759]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0" returned: 0 in 0.569s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:56 devstack sudo[97764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0 Sep 29 18:43:56 devstack sudo[97764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:56 devstack sudo[97764]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-92950ec3-8c1c-47e4-b698-6569877a36b0" returned: 0 in 0.351s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-92950ec3-8c1c-47e4-b698-6569877a36b0" released by "delete_volume" :: held 1.044s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Acquiring lock "cinder-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Lock "cinder-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Acquiring lock "cinder-quobyte-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:43:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Lock "cinder-quobyte-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5" acquired by "delete_volume" :: waited 0.042s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:43:56 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Created reservations ['22b66dc8-b1c7-4cf8-9101-dfbba24ab42c'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:56 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[462405ce-7be3-4e22-a5ef-b77fe18b6b41]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:43:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:56 devstack cinder-volume[86523]: WARNING cinder.db.api [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1911130067'] Sep 29 18:43:56 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Created reservations ['5a3f04d0-fabf-478c-b790-bbc5276d460b', 'f3cbf492-70b0-4b68-8e8a-42160334a493', 'b6531e89-33d7-42aa-ab72-0ecc30f42941', '3cf2907c-6f99-49ad-8bd5-a604eb9b0d6c'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:57 devstack sudo[97769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5 Sep 29 18:43:57 devstack sudo[97769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:57 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:43:57 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:57 devstack sudo[97769]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5" returned: 0 in 0.485s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:57 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5 Sep 29 18:43:57 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:57 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.315s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:43:57 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-b324da4d-c1d8-4acf-a570-51a5cc462933 tempest-GroupSnapshotsTest-1650590574 None] Delete group completed successfully. Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:43:57 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Flow 'volume_create_manager' (59742fad-4b60-4cbe-9663-0922818e6e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15eb4ba-d419-4b73-a90d-29c80061275b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5" returned: 0 in 0.458s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a15eb4ba-d419-4b73-a90d-29c80061275b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1766684875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a4c466-240a-401a-81a7-55559aedcc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40efdd6f5e524e0cafd2caf708df5cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:58Z,use_quota=True,user_id='a36d45ab3e2f48769419289b16cf304e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04567e29-25ce-4dab-85e2-dee2340bb9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04567e29-25ce-4dab-85e2-dee2340bb9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e182a1-8b04-428e-bf21-8d63bbe08498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92e182a1-8b04-428e-bf21-8d63bbe08498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9a4c466-240a-401a-81a7-55559aedcc9d', 'volume_name': 'volume-f9a4c466-240a-401a-81a7-55559aedcc9d', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de669173-a424-43c7-9f0c-b0603b159cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de669173-a424-43c7-9f0c-b0603b159cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4244220-a52c-463c-8582-bd4ad767ad4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:57 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Volume f9a4c466-240a-401a-81a7-55559aedcc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9a4c466-240a-401a-81a7-55559aedcc9d', 'volume_size': 1} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:43:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1766684875',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9a4c466-240a-401a-81a7-55559aedcc9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40efdd6f5e524e0cafd2caf708df5cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:43:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:43:58Z,use_quota=True,user_id='a36d45ab3e2f48769419289b16cf304e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Creating volume f9a4c466-240a-401a-81a7-55559aedcc9d {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:43:57 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Lock "cinder-quobyte-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5" released by "delete_volume" :: held 1.111s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:57 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d 1073741824 Sep 29 18:43:57 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:57 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Created reservations ['99802a22-7cc9-413f-a61e-542d0aa18224', 'f7d9f01e-b2b6-4e26-adfa-a57a9e7450c1', 'c05c84be-bb0b-4624-b207-ccd049f04a49', '4c2ae0f6-2bf3-4090-ab55-4ace8aa81100'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:58 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:43:58 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:58 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.387s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:43:58 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Deleted volume successfully. Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4e83a98f-4d9d-47f8-a478-30f05552db62 tempest-VolumesTransfersV355Test-115525641 None] Lock "cinder-dd3f34c7-0bb8-466a-b962-0721f0b4bcb5-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:43:58 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d 1073741824" returned: 0 in 0.660s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:58 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:43:58 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:43:58 devstack sudo[97793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d Sep 29 18:43:58 devstack sudo[97793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:43:58 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-fd994eb4-e78f-4f16-ae34-ad27443aa5d3 tempest-GroupSnapshotsTest-1650590574 None] Group tempest-GroupSnapshotsTest-Group-1752338050: creating Sep 29 18:43:58 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-fd994eb4-e78f-4f16-ae34-ad27443aa5d3 tempest-GroupSnapshotsTest-1650590574 None] Group tempest-GroupSnapshotsTest-Group-1752338050: created successfully Sep 29 18:43:58 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-fd994eb4-e78f-4f16-ae34-ad27443aa5d3 tempest-GroupSnapshotsTest-1650590574 None] Create group completed successfully. Sep 29 18:43:58 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.401s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:43:58 devstack sudo[97793]: pam_unix(sudo:session): session closed for user root Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d" returned: 0 in 0.341s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:43:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.114s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:43:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4244220-a52c-463c-8582-bd4ad767ad4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9a4c466-240a-401a-81a7-55559aedcc9d', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a66266-8406-42b6-90ec-e87f369a97a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:43:59 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Volume volume-f9a4c466-240a-401a-81a7-55559aedcc9d (f9a4c466-240a-401a-81a7-55559aedcc9d): created successfully Sep 29 18:43:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0a66266-8406-42b6-90ec-e87f369a97a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:43:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Flow 'volume_create_manager' (59742fad-4b60-4cbe-9663-0922818e6e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:43:59 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-39c51f57-e532-41d3-bc86-e6d80c513ddd tempest-VolumesSnapshotTestJSON-1546904908 None] Created volume successfully. Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "cinder-a1290148-eed8-4217-a349-6c3b5cfae7ef-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "cinder-a1290148-eed8-4217-a349-6c3b5cfae7ef-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "cinder-quobyte-a1290148-eed8-4217-a349-6c3b5cfae7ef" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "cinder-quobyte-a1290148-eed8-4217-a349-6c3b5cfae7ef" acquired by "delete_volume" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26e94bb-53b9-455e-a5e0-dc3d6532504f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a1290148-eed8-4217-a349-6c3b5cfae7ef {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:00 devstack sudo[97803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a1290148-eed8-4217-a349-6c3b5cfae7ef Sep 29 18:44:00 devstack sudo[97803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:00 devstack sudo[97803]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a1290148-eed8-4217-a349-6c3b5cfae7ef" returned: 0 in 0.480s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a1290148-eed8-4217-a349-6c3b5cfae7ef {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:00 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a1290148-eed8-4217-a349-6c3b5cfae7ef Sep 29 18:44:00 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Flow 'volume_create_manager' (ad2dfb32-c936-4fad-8b8b-74c13952df8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b9b21d-7527-4d5b-8b1d-6beff80a81c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29b9b21d-7527-4d5b-8b1d-6beff80a81c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-632858231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e315238b-d6dd-4ffe-85eb-01d72939dd77,host='devstack@QuobyteHD#QuobyteHD',id=e7b383ae-8d2d-4c07-bba4-937906b73fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1a128b13f54d9a87bbb11f295ae88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:01Z,use_quota=True,user_id='bcdbe94978e84df5b949f39b19aae8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb39db2c-a793-4191-bcb9-636b23634e08),volume_type_id=cb39db2c-a793-4191-bcb9-636b23634e08)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce05da6-a856-44c5-82f2-4e44b67a4ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ce05da6-a856-44c5-82f2-4e44b67a4ef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35601a86-a07a-4f0f-b2f2-b89201d681c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35601a86-a07a-4f0f-b2f2-b89201d681c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b383ae-8d2d-4c07-bba4-937906b73fd5', 'volume_name': 'volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd86ca8d-5744-4fb1-a297-0d966d012b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd86ca8d-5744-4fb1-a297-0d966d012b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a30344-a863-4f91-b0cc-be422d2ee9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:00 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Volume e7b383ae-8d2d-4c07-bba4-937906b73fd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5', 'volume_size': 1} Sep 29 18:44:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] Creating offline snapshot a4fa9575-a5ab-4102-a0e0-28cb074f335f of volume f9a4c466-240a-401a-81a7-55559aedcc9d {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8c7b2a-1667-41b1-bbaf-8f367febdc8d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:01 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a1290148-eed8-4217-a349-6c3b5cfae7ef" returned: 0 in 0.306s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:01 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d Sep 29 18:44:01 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "cinder-quobyte-a1290148-eed8-4217-a349-6c3b5cfae7ef" released by "delete_volume" :: held 0.860s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Created reservations ['89d137f9-7c45-46e0-aa2b-94a394582521', '743b0782-4474-41f1-87ef-1fc2e5dea75f', '3da6a7e2-fff4-4d63-8dca-46814c00e508', 'cacf4614-2ba9-4fd4-8627-129d70b17e4a'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:01 devstack sudo[97815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:44:01 devstack sudo[97815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:01 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d" returned: 0 in 0.438s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:01 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f 1G Sep 29 18:44:01 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:01 devstack sudo[97815]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.278s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:44:01 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Deleted volume successfully. Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b85c07cb-2a08-4188-ad46-6fc2a719a090 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "cinder-a1290148-eed8-4217-a349-6c3b5cfae7ef-delete_volume" released by "delete_volume" :: held 1.444s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "cinder-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "cinder-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "cinder-quobyte-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "cinder-quobyte-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e51ca00-a4df-4dac-aae6-99d1f7560463]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:02 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f 1G" returned: 0 in 0.549s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a4c466-240a-401a-81a7-55559aedcc9d -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:02 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a4c466-240a-401a-81a7-55559aedcc9d -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f Sep 29 18:44:02 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:02 devstack sudo[97827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7 Sep 29 18:44:02 devstack sudo[97827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:02 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9a4c466-240a-401a-81a7-55559aedcc9d -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f" returned: 0 in 0.344s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:02 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f is being set with open permissions: ugo+rw Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:02 devstack sudo[97837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f Sep 29 18:44:02 devstack sudo[97837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:02 devstack sudo[97827]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7" returned: 0 in 0.451s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:02 devstack sudo[97839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7 Sep 29 18:44:02 devstack sudo[97839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:02 devstack sudo[97837]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f" returned: 0 in 0.263s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:02 devstack sudo[97843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.info Sep 29 18:44:02 devstack sudo[97843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:02 devstack sudo[97839]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7" returned: 0 in 0.280s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "cinder-quobyte-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7" released by "delete_volume" :: held 0.787s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Created reservations ['7b90baed-e69a-40c8-98ca-ef52a6f68c54', '16d5c2c3-f383-4ecb-84ef-f9c29dad9d5b', '0b452047-df01-480f-9698-03f40771ec35', '9f6d39fd-7a92-4e22-bed4-37b01fc29510'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:02 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:44:02 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:02 devstack sudo[97843]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.info" returned: 0 in 0.292s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:02 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.info is being set with open permissions: ugo+rw Sep 29 18:44:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:03 devstack sudo[97849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.info Sep 29 18:44:03 devstack sudo[97849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:03 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.298s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:44:03 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Deleted volume successfully. Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ca34b5f9-d182-4317-81ff-a72593d0b411 tempest-AttachVolumeNegativeTest-1308614236 None] Lock "cinder-d9b469cf-22e0-4aaf-97c7-fa1e96a1e3a7-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:03 devstack sudo[97849]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.info" returned: 0 in 0.330s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.347s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e315238b-d6dd-4ffe-85eb-01d72939dd77,created_at=2026-09-29T16:44:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-632858231',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e315238b-d6dd-4ffe-85eb-01d72939dd77,host='devstack@QuobyteHD#QuobyteHD',id=e7b383ae-8d2d-4c07-bba4-937906b73fd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1a128b13f54d9a87bbb11f295ae88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:01Z,use_quota=True,user_id='bcdbe94978e84df5b949f39b19aae8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb39db2c-a793-4191-bcb9-636b23634e08),volume_type_id=cb39db2c-a793-4191-bcb9-636b23634e08)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Creating volume e7b383ae-8d2d-4c07-bba4-937906b73fd5 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:03 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:03 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 1073741824 Sep 29 18:44:03 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "cinder-a08a8b52-407c-4762-ba4f-22ca8cd3b79b-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Lock "cinder-a08a8b52-407c-4762-ba4f-22ca8cd3b79b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:03 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-15448abd-81ea-4d17-b453-2ea9ecb62020 tempest-VolumesSnapshotTestJSON-1546904908 None] Create snapshot completed successfully Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "cinder-quobyte-a08a8b52-407c-4762-ba4f-22ca8cd3b79b" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Lock "cinder-quobyte-a08a8b52-407c-4762-ba4f-22ca8cd3b79b" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd8a2cd-a20c-444f-8f8a-31daffaa8a16]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:03 devstack sudo[97856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b Sep 29 18:44:03 devstack sudo[97856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:03 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 1073741824" returned: 0 in 0.560s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:03 devstack sudo[97856]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b" returned: 0 in 0.434s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:03 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 Sep 29 18:44:03 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:04 devstack sudo[97867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b Sep 29 18:44:04 devstack sudo[97867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-a4fa9575-a5ab-4102-a0e0-28cb074f335f-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-a4fa9575-a5ab-4102-a0e0-28cb074f335f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-f9a4c466-240a-401a-81a7-55559aedcc9d" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-f9a4c466-240a-401a-81a7-55559aedcc9d" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-a4fa9575-a5ab-4102-a0e0-28cb074f335f" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-a4fa9575-a5ab-4102-a0e0-28cb074f335f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Deleting offline snapshot a4fa9575-a5ab-4102-a0e0-28cb074f335f of volume f9a4c466-240a-401a-81a7-55559aedcc9d {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] snapshot_file for this snap is: volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c1d90b-1d05-4c11-b60a-f9f36a21f88f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:04 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5" returned: 0 in 0.333s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6a30344-a863-4f91-b0cc-be422d2ee9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143872aa-f76d-42ce-b446-7e8071a141b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:04 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Volume volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 (e7b383ae-8d2d-4c07-bba4-937906b73fd5): created successfully Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (143872aa-f76d-42ce-b446-7e8071a141b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Flow 'volume_create_manager' (ad2dfb32-c936-4fad-8b8b-74c13952df8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:04 devstack sudo[97867]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a08a8b52-407c-4762-ba4f-22ca8cd3b79b" returned: 0 in 0.357s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Lock "cinder-quobyte-a08a8b52-407c-4762-ba4f-22ca8cd3b79b" released by "delete_volume" :: held 0.857s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:04 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a6052635-981a-4d1f-8a63-f4c890bca8e1 tempest-GroupSnapshotsTest-1650590574 None] Created volume successfully. Sep 29 18:44:04 devstack sudo[97870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f Sep 29 18:44:04 devstack sudo[97870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Created reservations ['df2343de-777f-41bf-838b-f6d229b1500c', '8a62a0a3-2755-4051-be05-d6fe2139e59a', 'ff01a1a8-f3f6-44fe-9e3f-d15761d9a854', 'ca946dff-97e8-4724-ae3c-ca7c7daa4ee9'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:04 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:44:04 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:04 devstack sudo[97870]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f" returned: 0 in 0.637s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9a4c466-240a-401a-81a7-55559aedcc9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7935d6-176e-40e1-b495-8cfb88c29df9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:04 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.401s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:04 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:44:04 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Deleted volume successfully. Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-44fb2026-0934-4fa5-a467-118f8151376b tempest-AttachVolumeNegativeTest-1308614236 None] Lock "cinder-a08a8b52-407c-4762-ba4f-22ca8cd3b79b-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:05 devstack sudo[97879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d Sep 29 18:44:05 devstack sudo[97879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Flow 'volume_create_manager' (eacf8f54-0b4f-45f7-9417-b9cbc30569a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f002a9ca-33de-45b1-b594-b88910de7837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f002a9ca-33de-45b1-b594-b88910de7837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1969523233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e315238b-d6dd-4ffe-85eb-01d72939dd77,host='devstack@QuobyteHD#QuobyteHD',id=0b51c299-5f28-46ab-b043-606e3671b37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1a128b13f54d9a87bbb11f295ae88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:05Z,use_quota=True,user_id='bcdbe94978e84df5b949f39b19aae8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb39db2c-a793-4191-bcb9-636b23634e08),volume_type_id=cb39db2c-a793-4191-bcb9-636b23634e08)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1194cda-f285-41cc-a490-f703fe2232b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1194cda-f285-41cc-a490-f703fe2232b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d17bd6-6b62-444d-9f78-0a96e7e930df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85d17bd6-6b62-444d-9f78-0a96e7e930df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b51c299-5f28-46ab-b043-606e3671b37b', 'volume_name': 'volume-0b51c299-5f28-46ab-b043-606e3671b37b', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5276f289-6f38-4b86-ae1d-ace8f0c46f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5276f289-6f38-4b86-ae1d-ace8f0c46f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5757f3-82b1-4e7e-bbae-4191c033371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:05 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Volume 0b51c299-5f28-46ab-b043-606e3671b37b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b51c299-5f28-46ab-b043-606e3671b37b', 'volume_size': 1} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e315238b-d6dd-4ffe-85eb-01d72939dd77,created_at=2026-09-29T16:44:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1969523233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e315238b-d6dd-4ffe-85eb-01d72939dd77,host='devstack@QuobyteHD#QuobyteHD',id=0b51c299-5f28-46ab-b043-606e3671b37b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1a128b13f54d9a87bbb11f295ae88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:05Z,use_quota=True,user_id='bcdbe94978e84df5b949f39b19aae8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cb39db2c-a793-4191-bcb9-636b23634e08),volume_type_id=cb39db2c-a793-4191-bcb9-636b23634e08)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Creating volume 0b51c299-5f28-46ab-b043-606e3671b37b {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:05 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:05 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b 1073741824 Sep 29 18:44:05 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:05 devstack sudo[97879]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d" returned: 0 in 0.660s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:05 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f Sep 29 18:44:05 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:05 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b 1073741824" returned: 0 in 0.532s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:05 devstack sudo[97895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b Sep 29 18:44:05 devstack sudo[97895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:06 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f" returned: 0 in 0.506s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:06 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f Sep 29 18:44:06 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:06 devstack sudo[97895]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b" returned: 0 in 0.322s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f5757f3-82b1-4e7e-bbae-4191c033371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b51c299-5f28-46ab-b043-606e3671b37b', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0640d12e-b510-47a9-a4aa-350c44fe516c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:06 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Volume volume-0b51c299-5f28-46ab-b043-606e3671b37b (0b51c299-5f28-46ab-b043-606e3671b37b): created successfully Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0640d12e-b510-47a9-a4aa-350c44fe516c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Flow 'volume_create_manager' (eacf8f54-0b4f-45f7-9417-b9cbc30569a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:06 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a6b13461-396d-434e-9cf2-934564e6df6c tempest-GroupSnapshotsTest-1650590574 None] Created volume successfully. Sep 29 18:44:06 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d.a4fa9575-a5ab-4102-a0e0-28cb074f335f" returned: 0 in 0.329s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-a4fa9575-a5ab-4102-a0e0-28cb074f335f" released by "_delete_snapshot" :: held 2.309s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-f9a4c466-240a-401a-81a7-55559aedcc9d" released by "delete_snapshot" :: held 2.349s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Created reservations ['76723026-188e-46a8-9b37-52004123a4ef', '45dde63a-c578-4fed-97f7-6dca6be5216a', 'c14d8b30-a058-450c-ab2d-4d981ce26311', '5939a3fb-0b73-440e-9670-0cb547aa26b5'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:06 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Delete snapshot completed successfully. Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f5712745-b558-4046-9e55-c9c3f5ab2f64 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-a4fa9575-a5ab-4102-a0e0-28cb074f335f-delete_snapshot" released by "delete_snapshot" :: held 2.594s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:06 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1d303dfc-cc93-4b69-9789-db7dbe57830d tempest-GroupSnapshotsTest-1650590574 None] Update group completed successfully. Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Flow 'volume_create_manager' (dcb9fd06-2701-42e9-91dc-9ca56b488111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdf8a3e-ffe9-4035-a98f-d070be2eb969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbdf8a3e-ffe9-4035-a98f-d070be2eb969) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1986172106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9face4fa-deff-478d-9945-c01f6bdb3672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626e0480fe6740b091661f8865d689a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:07Z,use_quota=True,user_id='d4378281ffba4784995e19bdab548939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb145da-66c9-4ab5-8b10-fe05c7aedb5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bb145da-66c9-4ab5-8b10-fe05c7aedb5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1540df9f-988f-4a47-a59e-f45cd3ec0214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1540df9f-988f-4a47-a59e-f45cd3ec0214) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9face4fa-deff-478d-9945-c01f6bdb3672', 'volume_name': 'volume-9face4fa-deff-478d-9945-c01f6bdb3672', 'volume_size': 2}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704f7d36-a17a-4279-82fc-233ffddeda5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (704f7d36-a17a-4279-82fc-233ffddeda5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fca15e0-06a6-4582-af2e-e874f9d2f05c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:07 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Volume 9face4fa-deff-478d-9945-c01f6bdb3672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9face4fa-deff-478d-9945-c01f6bdb3672', 'volume_size': 2} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1986172106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9face4fa-deff-478d-9945-c01f6bdb3672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='626e0480fe6740b091661f8865d689a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:07Z,use_quota=True,user_id='d4378281ffba4784995e19bdab548939',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Creating volume 9face4fa-deff-478d-9945-c01f6bdb3672 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:07 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672 2147483648 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:07 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672 2147483648 Sep 29 18:44:07 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:07 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672 2147483648" returned: 0 in 0.619s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:07 devstack sudo[97910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672 Sep 29 18:44:07 devstack sudo[97910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:07 devstack sudo[97910]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:07 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Flow 'volume_create_manager' (2989bfd5-37dd-44c8-b105-5df4b075a104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb94ccf4-2eda-4a62-9ad3-a2e2470638b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672" returned: 0 in 0.350s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb94ccf4-2eda-4a62-9ad3-a2e2470638b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-798290679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26739e29-e947-4fdd-a1b9-83b133a74b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40efdd6f5e524e0cafd2caf708df5cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:08Z,use_quota=True,user_id='a36d45ab3e2f48769419289b16cf304e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966289eb-6142-474d-9ccb-f7907f99615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (966289eb-6142-474d-9ccb-f7907f99615b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ad510b-3a50-441d-ac00-6a22016a10c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9ad510b-3a50-441d-ac00-6a22016a10c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26739e29-e947-4fdd-a1b9-83b133a74b45', 'volume_name': 'volume-26739e29-e947-4fdd-a1b9-83b133a74b45', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b043ad-e70c-4279-aabb-2fbbacbb149a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06b043ad-e70c-4279-aabb-2fbbacbb149a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93446e72-6170-4b2d-9f92-a2fb95a19def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:08 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Volume 26739e29-e947-4fdd-a1b9-83b133a74b45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26739e29-e947-4fdd-a1b9-83b133a74b45', 'volume_size': 1} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-798290679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26739e29-e947-4fdd-a1b9-83b133a74b45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40efdd6f5e524e0cafd2caf708df5cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:08Z,use_quota=True,user_id='a36d45ab3e2f48769419289b16cf304e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Creating volume 26739e29-e947-4fdd-a1b9-83b133a74b45 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:08 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fca15e0-06a6-4582-af2e-e874f9d2f05c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9face4fa-deff-478d-9945-c01f6bdb3672', 'volume_size': 2}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92616fd-3ad7-4963-b547-e8813b87ffc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:08 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 1073741824 Sep 29 18:44:08 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:08 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Volume volume-9face4fa-deff-478d-9945-c01f6bdb3672 (9face4fa-deff-478d-9945-c01f6bdb3672): created successfully Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c92616fd-3ad7-4963-b547-e8813b87ffc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Flow 'volume_create_manager' (dcb9fd06-2701-42e9-91dc-9ca56b488111) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:08 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8c1ce9ee-1849-4b1f-9401-1cf37bd89720 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Created volume successfully. Sep 29 18:44:08 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-26471dc1-1fb7-409c-9a10-7059daf87ddf tempest-GroupSnapshotsTest-1650590574 None] Update group completed successfully. Sep 29 18:44:08 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 1073741824" returned: 0 in 0.460s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:08 devstack sudo[97919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 Sep 29 18:44:08 devstack sudo[97919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:08 devstack sudo[97919]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45" returned: 0 in 0.295s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93446e72-6170-4b2d-9f92-a2fb95a19def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26739e29-e947-4fdd-a1b9-83b133a74b45', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fede167c-aa2f-4989-9aac-4b209d840860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:08 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Volume volume-26739e29-e947-4fdd-a1b9-83b133a74b45 (26739e29-e947-4fdd-a1b9-83b133a74b45): created successfully Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fede167c-aa2f-4989-9aac-4b209d840860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Flow 'volume_create_manager' (2989bfd5-37dd-44c8-b105-5df4b075a104) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:08 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4cede393-d05c-47c4-9beb-6166a941f7b9 tempest-VolumesSnapshotTestJSON-1546904908 None] Created volume successfully. Sep 29 18:44:09 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d1c3f917-1007-4552-98a9-bb3044db8276 tempest-GroupSnapshotsTest-1650590574 None] Update group completed successfully. Sep 29 18:44:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Creating offline snapshot a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 of volume 9face4fa-deff-478d-9945-c01f6bdb3672 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:44:09 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65e2ffb-e3a6-46d9-92ef-5da98addec6a]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:09 devstack sudo[97922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672 Sep 29 18:44:09 devstack sudo[97922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:09 devstack sudo[97922]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672" returned: 0 in 0.402s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 2G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:09 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 2G Sep 29 18:44:09 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:10 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 2G" returned: 0 in 0.525s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9face4fa-deff-478d-9945-c01f6bdb3672 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:10 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9face4fa-deff-478d-9945-c01f6bdb3672 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 Sep 29 18:44:10 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:10 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4a5b96ab-3eef-4390-9ef4-0eec58504888 tempest-GroupSnapshotsTest-1650590574 None] Update group completed successfully. Sep 29 18:44:10 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9face4fa-deff-478d-9945-c01f6bdb3672 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2" returned: 0 in 0.421s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:10 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 is being set with open permissions: ugo+rw Sep 29 18:44:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:10 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 Sep 29 18:44:10 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:10 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2" returned: 0 in 0.257s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:10 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.info Sep 29 18:44:10 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:11 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.info" returned: 0 in 0.266s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:11 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.info is being set with open permissions: ugo+rw Sep 29 18:44:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:11 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.info Sep 29 18:44:11 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:11 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.info" returned: 0 in 0.260s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.241s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.251s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] Creating offline snapshot dad49273-498f-4e7a-b317-3e490f2fcfaf of volume 26739e29-e947-4fdd-a1b9-83b133a74b45 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:44:11 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7f5c3fff-2474-4aaf-9ccf-e2149997b38d tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Create snapshot completed successfully Sep 29 18:44:11 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b506724-cc49-4c90-8f8a-4dff012aa615]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:11 devstack sudo[97949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 Sep 29 18:44:11 devstack sudo[97949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:11 devstack sudo[97949]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45" returned: 0 in 0.410s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:12 devstack sudo[97954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf 1G Sep 29 18:44:12 devstack sudo[97954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:12 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] GroupSnapshot 2154ab2f-293a-4e45-88da-6be3f6d85280: creating. Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Group snapshot 2154ab2f-293a-4e45-88da-6be3f6d85280: creating. {{(pid=86523) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4215}} Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:12 devstack sudo[97954]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf 1G" returned: 0 in 0.476s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26739e29-e947-4fdd-a1b9-83b133a74b45 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:12 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26739e29-e947-4fdd-a1b9-83b133a74b45 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf Sep 29 18:44:12 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Acquiring lock "cinder-a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "cinder-a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Acquiring lock "cinder-quobyte-9face4fa-deff-478d-9945-c01f6bdb3672" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "cinder-quobyte-9face4fa-deff-478d-9945-c01f6bdb3672" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Acquiring lock "cinder-quobyte-a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "cinder-quobyte-a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Deleting offline snapshot a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 of volume 9face4fa-deff-478d-9945-c01f6bdb3672 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] snapshot_file for this snap is: volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09cdda7-bd24-426e-ba9e-e9735de1b88f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:12 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 Sep 29 18:44:12 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:12 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26739e29-e947-4fdd-a1b9-83b133a74b45 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf" returned: 0 in 0.363s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:12 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf is being set with open permissions: ugo+rw Sep 29 18:44:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:12 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf Sep 29 18:44:12 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:13 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Flow 'volume_create_manager' (0c18adda-92b6-4c59-8481-1f3e7a22faf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919dfa59-b32d-4d51-82aa-eff027b45d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2" returned: 0 in 0.441s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9face4fa-deff-478d-9945-c01f6bdb3672(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:44:13 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf" returned: 0 in 0.282s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (919dfa59-b32d-4d51-82aa-eff027b45d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1258025093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61efb153-cebc-4305-b735-49d6a94bee2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37f95c505b2e4a25b75547bcdb42e29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:13Z,use_quota=True,user_id='4f2ae26f6a2d47189bd57648de9e04ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24a9579-6453-46f4-ada9-0e15967884d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b24a9579-6453-46f4-ada9-0e15967884d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e46f11-7770-4ea7-a885-da52724cbd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e46f11-7770-4ea7-a885-da52724cbd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61efb153-cebc-4305-b735-49d6a94bee2d', 'volume_name': 'volume-61efb153-cebc-4305-b735-49d6a94bee2d', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b3364f-6181-445d-ac0b-59bd3489862a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05b3364f-6181-445d-ac0b-59bd3489862a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a88361-8ef0-4982-9562-41f8a33a1089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:13 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Volume 61efb153-cebc-4305-b735-49d6a94bee2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61efb153-cebc-4305-b735-49d6a94bee2d', 'volume_size': 1} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b392d22a-6e26-429d-9124-69822d7888a1]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:13 devstack sudo[97975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.info Sep 29 18:44:13 devstack sudo[97975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:13 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672 Sep 29 18:44:13 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:13 devstack sudo[97975]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.info" returned: 0 in 0.261s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:13 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.info is being set with open permissions: ugo+rw Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:13 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.info Sep 29 18:44:13 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:13 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672" returned: 0 in 0.386s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:13 devstack sudo[97984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 Sep 29 18:44:13 devstack sudo[97984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:13 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.info" returned: 0 in 0.248s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.207s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.651s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Creating offline snapshot 09399fc9-4937-4219-9910-1da7c7d5fef2 of volume 0b51c299-5f28-46ab-b043-606e3671b37b {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a76481-e750-4666-b1c8-b0c9019f178b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:13 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f9d1cc24-d252-4fbd-8a3b-041e0e5aa2d5 tempest-VolumesSnapshotTestJSON-1546904908 None] Create snapshot completed successfully Sep 29 18:44:13 devstack sudo[97984]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2" returned: 0 in 0.344s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:13 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b Sep 29 18:44:13 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:13 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2 Sep 29 18:44:13 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:14 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672.a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2" returned: 0 in 0.260s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:14 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b" returned: 0 in 0.416s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "cinder-quobyte-a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2" released by "_delete_snapshot" :: held 1.615s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "cinder-quobyte-9face4fa-deff-478d-9945-c01f6bdb3672" released by "delete_snapshot" :: held 1.645s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:14 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 1G Sep 29 18:44:14 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Created reservations ['0c3102cd-9937-4604-8fd9-7cbe69002670', 'c7da749b-5b0a-41ed-9cad-e7288f874688', 'd1835e66-c21d-4662-9752-135dd51c56f4', '2e787bc5-fb60-42ef-8269-17d659d950cb'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:14 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Delete snapshot completed successfully. Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-157f89ef-5ede-4dee-97df-1dc47e49f2f4 tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "cinder-a1f32f2f-89ef-487e-8c5f-f2f1dc5b5ba2-delete_snapshot" released by "delete_snapshot" :: held 1.787s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:14 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 1G" returned: 0 in 0.417s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b51c299-5f28-46ab-b043-606e3671b37b -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:14 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b51c299-5f28-46ab-b043-606e3671b37b -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 Sep 29 18:44:14 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Acquiring lock "cinder-9face4fa-deff-478d-9945-c01f6bdb3672-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "cinder-9face4fa-deff-478d-9945-c01f6bdb3672-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Acquiring lock "cinder-quobyte-9face4fa-deff-478d-9945-c01f6bdb3672" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "cinder-quobyte-9face4fa-deff-478d-9945-c01f6bdb3672" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7611504-63e3-4c31-85c0-dd03d77b3951]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:14 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b51c299-5f28-46ab-b043-606e3671b37b -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2" returned: 0 in 0.389s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:14 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:15 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 Sep 29 18:44:15 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:15 devstack sudo[98009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672 Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:15 devstack sudo[98009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Flow 'volume_create_manager' (461d930a-a9da-4f17-8058-bc7f1640e4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1739f84-3ee5-48c0-9121-fbc70cf4235a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1739f84-3ee5-48c0-9121-fbc70cf4235a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-68810300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3900ff8-cf3b-4ebc-a978-bf00dcef72ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40efdd6f5e524e0cafd2caf708df5cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=dad49273-498f-4e7a-b317-3e490f2fcfaf,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:15Z,use_quota=True,user_id='a36d45ab3e2f48769419289b16cf304e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8026535-67f3-4213-bf60-b935a5068087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8026535-67f3-4213-bf60-b935a5068087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2faa67b-47ba-43de-ac26-782b063e5b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2faa67b-47ba-43de-ac26-782b063e5b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b3900ff8-cf3b-4ebc-a978-bf00dcef72ce', 'volume_name': 'volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce', 'volume_size': 2, 'snapshot_id': 'dad49273-498f-4e7a-b317-3e490f2fcfaf'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec9ed9d-aa11-46f1-b308-b4d453c775a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec9ed9d-aa11-46f1-b308-b4d453c775a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21b55f0-4412-41d4-ad03-b9e2aa337f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:15 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Volume b3900ff8-cf3b-4ebc-a978-bf00dcef72ce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce', 'volume_size': 2, 'snapshot_id': 'dad49273-498f-4e7a-b317-3e490f2fcfaf'} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:15 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2" returned: 0 in 0.274s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:15 devstack sudo[98018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.info Sep 29 18:44:15 devstack sudo[98018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:15 devstack sudo[98009]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672" returned: 0 in 0.416s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:15 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672 Sep 29 18:44:15 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:15 devstack sudo[98018]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.info" returned: 0 in 0.269s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:15 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:15 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.info Sep 29 18:44:15 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:15 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9face4fa-deff-478d-9945-c01f6bdb3672" returned: 0 in 0.251s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "cinder-quobyte-9face4fa-deff-478d-9945-c01f6bdb3672" released by "delete_volume" :: held 0.741s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Created reservations ['c5c7d437-e0a6-412f-981d-0e1dc62b0dc4', 'dd80621c-5442-4a41-aa0e-a271d73c92d2', '1e49b1d6-d470-472e-9245-cb913d0d4f76', '7e71186b-3094-451f-a031-bb8ff2f593bd'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:15 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:44:15 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:15 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.info" returned: 0 in 0.255s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.111s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Creating offline snapshot 150fed84-c603-43af-b1c6-cafac869ccd1 of volume e7b383ae-8d2d-4c07-bba4-937906b73fd5 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbee37ae-cb6a-4a9d-a734-27ad84513a50]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:15 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.254s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:15 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:44:16 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Deleted volume successfully. Sep 29 18:44:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-089aa2d5-dc6e-460d-ad54-8b242c9497de tempest-VolumesSnapshotNegativeTestJSON-1853351946 None] Lock "cinder-9face4fa-deff-478d-9945-c01f6bdb3672-delete_volume" released by "delete_volume" :: held 1.227s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:16 devstack sudo[98029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 Sep 29 18:44:16 devstack sudo[98029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:16 devstack sudo[98029]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5" returned: 0 in 0.405s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:16 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 1G Sep 29 18:44:16 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:16 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 1G" returned: 0 in 0.394s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:16 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 Sep 29 18:44:16 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:17 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1" returned: 0 in 0.323s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:17 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:17 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 Sep 29 18:44:17 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:17 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1" returned: 0 in 0.255s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:17 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.info Sep 29 18:44:17 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:17 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.info" returned: 0 in 0.280s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:17 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:17 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.info Sep 29 18:44:17 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:17 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.info" returned: 0 in 0.246s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.018s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.676s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-dad49273-498f-4e7a-b317-3e490f2fcfaf-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce" by "_create_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-dad49273-498f-4e7a-b317-3e490f2fcfaf-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Creating volume b3900ff8-cf3b-4ebc-a978-bf00dcef72ce from snapshot dad49273-498f-4e7a-b317-3e490f2fcfaf {{(pid=86523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce" by "_copy_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] snapshot: dad49273-498f-4e7a-b317-3e490f2fcfaf, volume: b3900ff8-cf3b-4ebc-a978-bf00dcef72ce, {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b13654-3f51-4ea8-b952-6109ec1d862b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:18 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1b20e1c5-9e06-445c-a83b-fd5850452237 tempest-GroupSnapshotsTest-1650590574 None] group_snapshot 2154ab2f-293a-4e45-88da-6be3f6d85280: created successfully Sep 29 18:44:18 devstack sudo[98054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf Sep 29 18:44:18 devstack sudo[98054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:18 devstack sudo[98054]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf" returned: 0 in 0.415s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26739e29-e947-4fdd-a1b9-83b133a74b45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b71c20-4d10-44ef-9bc0-7d308e7acb91]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:18 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 Sep 29 18:44:18 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:18 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] group_snapshot 2154ab2f-293a-4e45-88da-6be3f6d85280: deleting Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] group_snapshot 2154ab2f-293a-4e45-88da-6be3f6d85280: deleting {{(pid=86523) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4390}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-0b51c299-5f28-46ab-b043-606e3671b37b" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-0b51c299-5f28-46ab-b043-606e3671b37b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-09399fc9-4937-4219-9910-1da7c7d5fef2" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-09399fc9-4937-4219-9910-1da7c7d5fef2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Deleting offline snapshot 09399fc9-4937-4219-9910-1da7c7d5fef2 of volume 0b51c299-5f28-46ab-b043-606e3671b37b {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] snapshot_file for this snap is: volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9076159-6048-446e-a205-f56090cd2c10]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:18 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 Sep 29 18:44:18 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:18 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45" returned: 0 in 0.530s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Creating direct copy from snapshot {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG cinder.utils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Path /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce not found in is_blk_device check {{(pid=86523) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:44:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:18 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce Sep 29 18:44:18 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:19 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2" returned: 0 in 0.467s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b51c299-5f28-46ab-b043-606e3671b37b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:44:19 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd28809-f404-40ab-856e-a89d5db41ba6]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:19 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b Sep 29 18:44:19 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:19 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b" returned: 0 in 0.665s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:19 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 Sep 29 18:44:19 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:20 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2" returned: 0 in 0.966s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:20 devstack sudo[98094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2 Sep 29 18:44:20 devstack sudo[98094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:21 devstack sudo[98094]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b.09399fc9-4937-4219-9910-1da7c7d5fef2" returned: 0 in 0.451s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-09399fc9-4937-4219-9910-1da7c7d5fef2" released by "_delete_snapshot" :: held 2.736s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-0b51c299-5f28-46ab-b043-606e3671b37b" released by "delete_snapshot" :: held 2.772s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-e7b383ae-8d2d-4c07-bba4-937906b73fd5" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-e7b383ae-8d2d-4c07-bba4-937906b73fd5" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-150fed84-c603-43af-b1c6-cafac869ccd1" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-150fed84-c603-43af-b1c6-cafac869ccd1" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Deleting offline snapshot 150fed84-c603-43af-b1c6-cafac869ccd1 of volume e7b383ae-8d2d-4c07-bba4-937906b73fd5 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:44:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] snapshot_file for this snap is: volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:44:21 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d80f81-2a48-4331-9403-1348ea9b051e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:21 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 Sep 29 18:44:21 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:22 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1" returned: 0 in 0.759s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:44:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[371e6903-297a-4ed1-8647-e9f9dbd49412]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:22 devstack sudo[98103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 Sep 29 18:44:22 devstack sudo[98103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:23 devstack sudo[98103]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5" returned: 0 in 0.822s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:23 devstack sudo[98109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 Sep 29 18:44:23 devstack sudo[98109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:24 devstack sudo[98109]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1" returned: 0 in 0.753s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:24 devstack sudo[98115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1 Sep 29 18:44:24 devstack sudo[98115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:24 devstack sudo[98115]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5.150fed84-c603-43af-b1c6-cafac869ccd1" returned: 0 in 0.517s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-150fed84-c603-43af-b1c6-cafac869ccd1" released by "_delete_snapshot" :: held 3.108s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-e7b383ae-8d2d-4c07-bba4-937906b73fd5" released by "delete_snapshot" :: held 3.170s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:24 devstack cinder-volume[86523]: WARNING cinder.quota [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1355003635 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1355003635, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:44:24 devstack cinder-volume[86523]: WARNING cinder.quota [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1355003635 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1355003635, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:44:24 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Created reservations ['9db91773-4395-4e6e-8bbf-6fc60431ae62', 'c216f8d2-0af7-4806-9aa4-f014d285a913', '44387577-35f2-4ae0-9d8a-256117e2ba40', '87da7f37-da8d-40a4-bdcb-0c9624bd3d6a'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:25 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] Created reservations ['839994fb-d1f6-4b8f-8097-5e25a3615b28', 'c03ae8f2-2130-4833-969d-cc9b2f5faab0', 'fd7c36c1-4455-433b-a379-1c7bf2831298', '55ca9497-9f71-4436-98d2-ecd0631abfcf'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:25 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-0de51a35-f236-4fdf-b0f9-864c30d40180 tempest-GroupSnapshotsTest-1650590574 None] group_snapshot 2154ab2f-293a-4e45-88da-6be3f6d85280: deleted successfully Sep 29 18:44:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-0b51c299-5f28-46ab-b043-606e3671b37b" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-0b51c299-5f28-46ab-b043-606e3671b37b" acquired by "delete_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:26 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efa2c36-48d9-4fb6-ab72-0945e7ede9b9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:26 devstack sudo[98118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b Sep 29 18:44:26 devstack sudo[98118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:26 devstack sudo[98118]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b" returned: 0 in 0.697s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:26 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce" returned: 0 in 8.017s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:26 devstack sudo[98123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b Sep 29 18:44:26 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45, size 1024.00 MB, duration 8.02 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:44:26 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Converted 1024.00 MB image at 127.70 MB/s Sep 29 18:44:26 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce is being set with open permissions: ugo+rw Sep 29 18:44:26 devstack sudo[98123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:27 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce Sep 29 18:44:27 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:27 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce" returned: 0 in 0.333s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce" released by "_copy_volume_from_snapshot" :: held 9.403s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:27 devstack sudo[98123]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0b51c299-5f28-46ab-b043-606e3671b37b" returned: 0 in 0.381s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-0b51c299-5f28-46ab-b043-606e3671b37b" released by "delete_volume" :: held 1.197s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-e7b383ae-8d2d-4c07-bba4-937906b73fd5" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-e7b383ae-8d2d-4c07-bba4-937906b73fd5" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-dad49273-498f-4e7a-b317-3e490f2fcfaf-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce" released by "_create_volume_from_snapshot" :: held 9.528s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.555s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.272s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1258025093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61efb153-cebc-4305-b735-49d6a94bee2d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37f95c505b2e4a25b75547bcdb42e29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:13Z,use_quota=True,user_id='4f2ae26f6a2d47189bd57648de9e04ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Creating volume 61efb153-cebc-4305-b735-49d6a94bee2d {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:27 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61efb153-cebc-4305-b735-49d6a94bee2d 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e4c128-15af-411a-9f14-4eb0c7bff27e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:27 devstack sudo[98129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61efb153-cebc-4305-b735-49d6a94bee2d 1073741824 Sep 29 18:44:27 devstack sudo[98129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e21b55f0-4412-41d4-ad03-b9e2aa337f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce', 'volume_size': 2, 'snapshot_id': 'dad49273-498f-4e7a-b317-3e490f2fcfaf'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6b2a65-a27f-4e68-b51d-2ec9aa03fee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:27 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Volume volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce (b3900ff8-cf3b-4ebc-a978-bf00dcef72ce): created successfully Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e6b2a65-a27f-4e68-b51d-2ec9aa03fee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Flow 'volume_create_manager' (461d930a-a9da-4f17-8058-bc7f1640e4db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-abe353f7-86e5-4607-b120-91f4abd11f0b tempest-VolumesSnapshotTestJSON-1546904908 None] Created volume successfully. Sep 29 18:44:27 devstack sudo[98130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 Sep 29 18:44:27 devstack sudo[98130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:27 devstack sudo[98129]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61efb153-cebc-4305-b735-49d6a94bee2d 1073741824" returned: 0 in 0.489s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:27 devstack sudo[98130]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5" returned: 0 in 0.489s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:27 devstack sudo[98140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5 Sep 29 18:44:27 devstack sudo[98140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61efb153-cebc-4305-b735-49d6a94bee2d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:28 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61efb153-cebc-4305-b735-49d6a94bee2d Sep 29 18:44:28 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:28 devstack sudo[98140]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:28 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e7b383ae-8d2d-4c07-bba4-937906b73fd5" returned: 0 in 0.454s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61efb153-cebc-4305-b735-49d6a94bee2d" returned: 0 in 0.427s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] <== create_volume: return (1003ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-e7b383ae-8d2d-4c07-bba4-937906b73fd5" released by "delete_volume" :: held 1.052s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11a88361-8ef0-4982-9562-41f8a33a1089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61efb153-cebc-4305-b735-49d6a94bee2d', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402887f3-3b8d-4bef-83c5-875ad0e89393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:28 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Volume volume-61efb153-cebc-4305-b735-49d6a94bee2d (61efb153-cebc-4305-b735-49d6a94bee2d): created successfully Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (402887f3-3b8d-4bef-83c5-875ad0e89393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Flow 'volume_create_manager' (0c18adda-92b6-4c59-8481-1f3e7a22faf7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce" acquired by "delete_volume" :: waited 0.029s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:28 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-bfa47913-4388-479b-96f4-a298f0e49ef2 tempest-VolumesTestJSON-1724138377 None] Created volume successfully. Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[023b9062-e60a-4f6c-a8f2-988fc89d858e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Created reservations ['6ac84f3d-1f1e-46b8-85c4-10d7d195d764'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:28 devstack cinder-volume[86523]: WARNING cinder.quota [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1355003635 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1355003635, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Created reservations ['f6ff28c7-d773-4fe8-b71d-4b82a1ee7876', 'e86e3876-9b14-4185-9e95-8162284bd0eb', '82bbbd87-f3f7-41bd-9093-ab8bba46303e', 'f711b338-6bd0-4075-a709-45592a952f45'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:28 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce Sep 29 18:44:28 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:28 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Created reservations ['091bbbb4-fd6c-424c-88d3-fa70b4b5d745', '53501ed3-f2cf-4a55-b1c9-8ee3e9d2d7d3', '7365a7ce-bdcd-4185-ab18-b938e6c47a21', 'ecda4705-1f5e-4d94-ab4b-176d51ab696e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:29 devstack sudo[98151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:44:29 devstack sudo[98151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:29 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce" returned: 0 in 0.526s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:29 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce Sep 29 18:44:29 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:29 devstack sudo[98151]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.297s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:44:29 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-572bce08-b346-4ac6-b20e-796f405bc055 tempest-GroupSnapshotsTest-1650590574 None] Delete group completed successfully. Sep 29 18:44:29 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce" returned: 0 in 0.431s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce" released by "delete_volume" :: held 1.035s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Created reservations ['07efb733-3a9b-49fb-98b8-fa11cc9a1b77', '91b453e1-4c36-4c2c-941a-7203d4fec85a', '90819e1f-841f-42d6-8895-af1022ef324f', '06f5bd07-5dca-48d0-bde2-e334ff4e9efe'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:29 devstack sudo[98157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:44:29 devstack sudo[98157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:30 devstack sudo[98157]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.332s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:44:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Deleted volume successfully. Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c3c7e478-122f-4439-a915-f2c076c2dc38 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-b3900ff8-cf3b-4ebc-a978-bf00dcef72ce-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Flow 'volume_create_manager' (4a6172fd-3f85-472a-8724-93677e492b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8af9a97-3eed-43e2-b213-19aa8c8c37a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8af9a97-3eed-43e2-b213-19aa8c8c37a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-186492632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bea6836-5532-40fe-b274-7cd22bb224e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37f95c505b2e4a25b75547bcdb42e29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:30Z,use_quota=True,user_id='4f2ae26f6a2d47189bd57648de9e04ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d5ce5c-2725-48e8-ae1a-693c3477a916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d5ce5c-2725-48e8-ae1a-693c3477a916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de5afd1-cfa7-4391-bff2-f0876a9f3c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4de5afd1-cfa7-4391-bff2-f0876a9f3c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8bea6836-5532-40fe-b274-7cd22bb224e5', 'volume_name': 'volume-8bea6836-5532-40fe-b274-7cd22bb224e5', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffce4b3-419c-4e4b-9c78-14ee7b56d040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bffce4b3-419c-4e4b-9c78-14ee7b56d040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20da0dda-b3ff-449c-9bad-03a6af8fb352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:30 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Volume 8bea6836-5532-40fe-b274-7cd22bb224e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8bea6836-5532-40fe-b274-7cd22bb224e5', 'volume_size': 1} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-186492632',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8bea6836-5532-40fe-b274-7cd22bb224e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37f95c505b2e4a25b75547bcdb42e29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:30Z,use_quota=True,user_id='4f2ae26f6a2d47189bd57648de9e04ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Creating volume 8bea6836-5532-40fe-b274-7cd22bb224e5 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:30 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8bea6836-5532-40fe-b274-7cd22bb224e5 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:30 devstack sudo[98160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8bea6836-5532-40fe-b274-7cd22bb224e5 1073741824 Sep 29 18:44:30 devstack sudo[98160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-dad49273-498f-4e7a-b317-3e490f2fcfaf-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-dad49273-498f-4e7a-b317-3e490f2fcfaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-26739e29-e947-4fdd-a1b9-83b133a74b45" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-26739e29-e947-4fdd-a1b9-83b133a74b45" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-dad49273-498f-4e7a-b317-3e490f2fcfaf" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6c0b7f7e-d5d6-4464-82c0-1970006634f7 tempest-GroupSnapshotsTest-1650590574 None] Group tempest-GroupSnapshotsTest-Group-241475232: creating Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-dad49273-498f-4e7a-b317-3e490f2fcfaf" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Deleting offline snapshot dad49273-498f-4e7a-b317-3e490f2fcfaf of volume 26739e29-e947-4fdd-a1b9-83b133a74b45 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] snapshot_file for this snap is: volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f4ea59-98df-4c36-8061-cb5adccde273]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6c0b7f7e-d5d6-4464-82c0-1970006634f7 tempest-GroupSnapshotsTest-1650590574 None] Group tempest-GroupSnapshotsTest-Group-241475232: created successfully Sep 29 18:44:31 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6c0b7f7e-d5d6-4464-82c0-1970006634f7 tempest-GroupSnapshotsTest-1650590574 None] Create group completed successfully. Sep 29 18:44:31 devstack sudo[98165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf Sep 29 18:44:31 devstack sudo[98165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:31 devstack sudo[98160]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8bea6836-5532-40fe-b274-7cd22bb224e5 1073741824" returned: 0 in 0.669s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8bea6836-5532-40fe-b274-7cd22bb224e5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:31 devstack sudo[98169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8bea6836-5532-40fe-b274-7cd22bb224e5 Sep 29 18:44:31 devstack sudo[98169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:31 devstack sudo[98165]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf" returned: 0 in 0.482s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26739e29-e947-4fdd-a1b9-83b133a74b45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:44:31 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3ca780b-39ba-407e-87c4-ad6f6580ac18]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:31 devstack sudo[98169]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8bea6836-5532-40fe-b274-7cd22bb224e5" returned: 0 in 0.298s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:44:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20da0dda-b3ff-449c-9bad-03a6af8fb352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8bea6836-5532-40fe-b274-7cd22bb224e5', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c17f1bf-9cef-48d8-9ffc-f549308303c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:31 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Volume volume-8bea6836-5532-40fe-b274-7cd22bb224e5 (8bea6836-5532-40fe-b274-7cd22bb224e5): created successfully Sep 29 18:44:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c17f1bf-9cef-48d8-9ffc-f549308303c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:31 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 Sep 29 18:44:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Flow 'volume_create_manager' (4a6172fd-3f85-472a-8724-93677e492b34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:31 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:31 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-729b13c7-4698-48ae-839b-d6651b6665be tempest-VolumesTestJSON-1724138377 None] Created volume successfully. Sep 29 18:44:32 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45" returned: 0 in 0.724s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:32 devstack sudo[98182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf Sep 29 18:44:32 devstack sudo[98182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Flow 'volume_create_manager' (45d63f40-7333-465b-95cb-2867bf129a91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76698584-cb03-4419-98eb-05914c4d0836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76698584-cb03-4419-98eb-05914c4d0836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-308132756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f18adcaa-cf33-448c-8bc6-4e7ffa2946f7,host='devstack@QuobyteHD#QuobyteHD',id=2c399806-2679-421e-9c36-969d92354735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1a128b13f54d9a87bbb11f295ae88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:33Z,use_quota=True,user_id='bcdbe94978e84df5b949f39b19aae8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc5ce498-9ed5-4d3f-b5ca-ff69d4d438ea),volume_type_id=cc5ce498-9ed5-4d3f-b5ca-ff69d4d438ea)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f021633-ccce-4665-a24c-99346bb27002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f021633-ccce-4665-a24c-99346bb27002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacefdc9-2def-4328-9e83-5ae09fc7b770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aacefdc9-2def-4328-9e83-5ae09fc7b770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c399806-2679-421e-9c36-969d92354735', 'volume_name': 'volume-2c399806-2679-421e-9c36-969d92354735', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcdd2b0-f17e-4522-8d0e-4812770ee9fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dcdd2b0-f17e-4522-8d0e-4812770ee9fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd18a034-0bc6-4c1a-904e-e6cd91d00353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:32 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Volume 2c399806-2679-421e-9c36-969d92354735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c399806-2679-421e-9c36-969d92354735', 'volume_size': 1} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=f18adcaa-cf33-448c-8bc6-4e7ffa2946f7,created_at=2026-09-29T16:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-308132756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=f18adcaa-cf33-448c-8bc6-4e7ffa2946f7,host='devstack@QuobyteHD#QuobyteHD',id=2c399806-2679-421e-9c36-969d92354735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1a128b13f54d9a87bbb11f295ae88d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:33Z,use_quota=True,user_id='bcdbe94978e84df5b949f39b19aae8d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cc5ce498-9ed5-4d3f-b5ca-ff69d4d438ea),volume_type_id=cc5ce498-9ed5-4d3f-b5ca-ff69d4d438ea)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Creating volume 2c399806-2679-421e-9c36-969d92354735 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:32 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:32 devstack sudo[98182]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf" returned: 0 in 0.636s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:32 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735 1073741824 Sep 29 18:44:32 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:32 devstack sudo[98189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf Sep 29 18:44:32 devstack sudo[98189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:33 devstack sudo[98189]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45.dad49273-498f-4e7a-b317-3e490f2fcfaf" returned: 0 in 0.374s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-dad49273-498f-4e7a-b317-3e490f2fcfaf" released by "_delete_snapshot" :: held 2.408s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-26739e29-e947-4fdd-a1b9-83b133a74b45" released by "delete_snapshot" :: held 2.461s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Flow 'volume_create_manager' (f3fbdfa3-2369-41b3-b356-097d1e1c74c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef7b914-850e-4db7-85f6-1291278d08dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cef7b914-850e-4db7-85f6-1291278d08dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1303822399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549b210e-234b-4866-8039-40c171068c4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37f95c505b2e4a25b75547bcdb42e29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:33Z,use_quota=True,user_id='4f2ae26f6a2d47189bd57648de9e04ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd8868d-5be3-4810-a88b-9eb86322fd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd8868d-5be3-4810-a88b-9eb86322fd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64856b4-5721-43ec-93a7-f8a211748942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e64856b4-5721-43ec-93a7-f8a211748942) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '549b210e-234b-4866-8039-40c171068c4f', 'volume_name': 'volume-549b210e-234b-4866-8039-40c171068c4f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378d7806-fab3-4a9b-9f85-05d93ab02608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378d7806-fab3-4a9b-9f85-05d93ab02608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1f717b-f3d9-40fc-96e8-d478768a4621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:33 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Volume 549b210e-234b-4866-8039-40c171068c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-549b210e-234b-4866-8039-40c171068c4f', 'volume_size': 1} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:33 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735 1073741824" returned: 0 in 0.609s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Created reservations ['5347933c-453e-4aef-ab74-799b41e206d6', 'b7e3bd55-c565-45fd-b712-bcdfee355b13', '94fbbc64-b54a-45fd-9ab3-2aaf42243310', 'c539996c-30aa-4a4b-91a2-519703fa8bbf'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:33 devstack sudo[98198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735 Sep 29 18:44:33 devstack sudo[98198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:33 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Delete snapshot completed successfully. Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4df76649-caf5-424c-a6e3-d6b7da0b01d3 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-dad49273-498f-4e7a-b317-3e490f2fcfaf-delete_snapshot" released by "delete_snapshot" :: held 2.761s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:33 devstack sudo[98198]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735" returned: 0 in 0.267s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] <== create_volume: return (960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.356s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1303822399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=549b210e-234b-4866-8039-40c171068c4f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='37f95c505b2e4a25b75547bcdb42e29e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:33Z,use_quota=True,user_id='4f2ae26f6a2d47189bd57648de9e04ef',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Creating volume 549b210e-234b-4866-8039-40c171068c4f {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:33 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-549b210e-234b-4866-8039-40c171068c4f 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd18a034-0bc6-4c1a-904e-e6cd91d00353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c399806-2679-421e-9c36-969d92354735', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:33 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-549b210e-234b-4866-8039-40c171068c4f 1073741824 Sep 29 18:44:33 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905f5364-e6fd-4787-9f23-151959dc4f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:33 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Volume volume-2c399806-2679-421e-9c36-969d92354735 (2c399806-2679-421e-9c36-969d92354735): created successfully Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (905f5364-e6fd-4787-9f23-151959dc4f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Flow 'volume_create_manager' (45d63f40-7333-465b-95cb-2867bf129a91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:33 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d1c402c7-5ca2-452e-b503-d372a83b6e97 tempest-GroupSnapshotsTest-1650590574 None] Created volume successfully. Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-26739e29-e947-4fdd-a1b9-83b133a74b45-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-26739e29-e947-4fdd-a1b9-83b133a74b45-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-26739e29-e947-4fdd-a1b9-83b133a74b45" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-26739e29-e947-4fdd-a1b9-83b133a74b45" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:34 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] GroupSnapshot a0941f5b-18ac-46f7-8ae4-079973628a3f: creating. Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ba9635-14bb-401b-8db9-43609c91291e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] Group snapshot a0941f5b-18ac-46f7-8ae4-079973628a3f: creating. {{(pid=86523) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4215}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:34 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-549b210e-234b-4866-8039-40c171068c4f 1073741824" returned: 0 in 0.719s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:34 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 Sep 29 18:44:34 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-549b210e-234b-4866-8039-40c171068c4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:34 devstack sudo[98211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-549b210e-234b-4866-8039-40c171068c4f Sep 29 18:44:34 devstack sudo[98211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:34 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45" returned: 0 in 0.445s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:34 devstack sudo[98211]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-549b210e-234b-4866-8039-40c171068c4f" returned: 0 in 0.286s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:34 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45 Sep 29 18:44:34 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.421s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c1f717b-f3d9-40fc-96e8-d478768a4621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-549b210e-234b-4866-8039-40c171068c4f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6b6f03-0bfb-4d58-8129-9877d1232b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] Creating offline snapshot 3765a807-9e81-49d6-a71a-c7eeff20d7bf of volume 2c399806-2679-421e-9c36-969d92354735 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:44:34 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Volume volume-549b210e-234b-4866-8039-40c171068c4f (549b210e-234b-4866-8039-40c171068c4f): created successfully Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a6b6f03-0bfb-4d58-8129-9877d1232b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Flow 'volume_create_manager' (f3fbdfa3-2369-41b3-b356-097d1e1c74c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9185b6f-b115-45e1-b88b-631970d4ba44]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:34 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-fc2730df-4560-4faa-99e7-420e7f78aec4 tempest-VolumesTestJSON-1724138377 None] Created volume successfully. Sep 29 18:44:35 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735 Sep 29 18:44:35 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:35 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-26739e29-e947-4fdd-a1b9-83b133a74b45" returned: 0 in 0.278s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-26739e29-e947-4fdd-a1b9-83b133a74b45" released by "delete_volume" :: held 0.841s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Created reservations ['306e5970-ed03-43d0-ad5b-20b3eb48b063', '7ebbfb0b-5ee0-4efa-8f39-198089f8907f', '9ed1baa3-c15e-4347-a551-76381cc1c15c', '6520e985-3e75-4175-b682-876c175cfa26'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:35 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:44:35 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:35 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735" returned: 0 in 0.449s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:35 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf 1G Sep 29 18:44:35 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:35 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.356s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:44:35 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Deleted volume successfully. Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-71a86cc7-5a7c-469e-97ee-fd0d9f42cbb3 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-26739e29-e947-4fdd-a1b9-83b133a74b45-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:35 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf 1G" returned: 0 in 0.553s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c399806-2679-421e-9c36-969d92354735 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:35 devstack sudo[98234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c399806-2679-421e-9c36-969d92354735 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf Sep 29 18:44:35 devstack sudo[98234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Flow 'volume_create_manager' (fb1ad991-f1ee-4ffb-87d5-7f6d416ea6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c2382f-a8c2-4d1e-8d8a-0a7e095bff66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c2382f-a8c2-4d1e-8d8a-0a7e095bff66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2065726490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f8848b5-f5f7-4f00-80ef-403b71bb4f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40efdd6f5e524e0cafd2caf708df5cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:36Z,use_quota=True,user_id='a36d45ab3e2f48769419289b16cf304e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ac577a-c942-4b44-8f30-89c8b9e1921b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ac577a-c942-4b44-8f30-89c8b9e1921b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee853f23-af58-4a3a-9c56-70ff8c8c0dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee853f23-af58-4a3a-9c56-70ff8c8c0dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f8848b5-f5f7-4f00-80ef-403b71bb4f5e', 'volume_name': 'volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae3d69b-2874-4e80-8df3-a0dfec9408dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ae3d69b-2874-4e80-8df3-a0dfec9408dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12e972b-c9a3-403a-a6e6-c5dab90d171e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:36 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Volume 8f8848b5-f5f7-4f00-80ef-403b71bb4f5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e', 'volume_size': 1} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:36 devstack sudo[98234]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2c399806-2679-421e-9c36-969d92354735 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf" returned: 0 in 0.430s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:36 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:36 devstack sudo[98239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf Sep 29 18:44:36 devstack sudo[98239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:36 devstack sudo[98239]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf" returned: 0 in 0.354s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:36 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.info Sep 29 18:44:36 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Acquiring lock "cinder-549b210e-234b-4866-8039-40c171068c4f-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Lock "cinder-549b210e-234b-4866-8039-40c171068c4f-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Acquiring lock "cinder-quobyte-549b210e-234b-4866-8039-40c171068c4f" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Lock "cinder-quobyte-549b210e-234b-4866-8039-40c171068c4f" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ac46bb-32b3-4b6a-84bc-905291988f42]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-549b210e-234b-4866-8039-40c171068c4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:37 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.info" returned: 0 in 0.297s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:37 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:37 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.info Sep 29 18:44:37 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:37 devstack sudo[98244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-549b210e-234b-4866-8039-40c171068c4f Sep 29 18:44:37 devstack sudo[98244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:37 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.info" returned: 0 in 0.291s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.052s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-2065726490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f8848b5-f5f7-4f00-80ef-403b71bb4f5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40efdd6f5e524e0cafd2caf708df5cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:36Z,use_quota=True,user_id='a36d45ab3e2f48769419289b16cf304e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Creating volume 8f8848b5-f5f7-4f00-80ef-403b71bb4f5e {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:37 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:37 devstack sudo[98244]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:37 devstack sudo[98255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e 1073741824 Sep 29 18:44:37 devstack sudo[98255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-549b210e-234b-4866-8039-40c171068c4f" returned: 0 in 0.437s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-549b210e-234b-4866-8039-40c171068c4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:37 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-549b210e-234b-4866-8039-40c171068c4f Sep 29 18:44:37 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:37 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8c027e8c-9d17-4b6a-857e-0595f234f6d0 tempest-GroupSnapshotsTest-1650590574 None] group_snapshot a0941f5b-18ac-46f7-8ae4-079973628a3f: created successfully Sep 29 18:44:37 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-549b210e-234b-4866-8039-40c171068c4f" returned: 0 in 0.323s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Lock "cinder-quobyte-549b210e-234b-4866-8039-40c171068c4f" released by "delete_volume" :: held 0.825s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Created reservations ['8b015e71-7935-4625-b092-8fdd32f1fdc6', 'c867a1d3-5b2a-405a-9f29-7a65468bcd6d', '408d3bbd-c137-4d0f-8437-f68bce2cca68', '540fb5e9-53d1-4826-9a07-606b3f25ff9f'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:37 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] group_snapshot a0941f5b-18ac-46f7-8ae4-079973628a3f: deleting Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] group_snapshot a0941f5b-18ac-46f7-8ae4-079973628a3f: deleting {{(pid=86523) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4390}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-2c399806-2679-421e-9c36-969d92354735" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:37 devstack sudo[98255]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-2c399806-2679-421e-9c36-969d92354735" acquired by "delete_snapshot" :: waited 0.067s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-3765a807-9e81-49d6-a71a-c7eeff20d7bf" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e 1073741824" returned: 0 in 0.627s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:37 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:44:37 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-3765a807-9e81-49d6-a71a-c7eeff20d7bf" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Deleting offline snapshot 3765a807-9e81-49d6-a71a-c7eeff20d7bf of volume 2c399806-2679-421e-9c36-969d92354735 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] snapshot_file for this snap is: volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Acquiring lock "cinder-8bea6836-5532-40fe-b274-7cd22bb224e5-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[655d3e73-832a-4294-835a-b9865d61881a]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Lock "cinder-8bea6836-5532-40fe-b274-7cd22bb224e5-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:38 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e Sep 29 18:44:38 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Acquiring lock "cinder-quobyte-8bea6836-5532-40fe-b274-7cd22bb224e5" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Lock "cinder-quobyte-8bea6836-5532-40fe-b274-7cd22bb224e5" acquired by "delete_volume" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5226dda9-4c88-489a-8a9f-dfefbfd664a4]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8bea6836-5532-40fe-b274-7cd22bb224e5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:38 devstack sudo[98266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf Sep 29 18:44:38 devstack sudo[98266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:38 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.427s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:44:38 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Deleted volume successfully. Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-48969d62-a1df-441f-a8fb-9b76b9d673cf tempest-VolumesTestJSON-1724138377 None] Lock "cinder-549b210e-234b-4866-8039-40c171068c4f-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:38 devstack sudo[98269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8bea6836-5532-40fe-b274-7cd22bb224e5 Sep 29 18:44:38 devstack sudo[98269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:38 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e" returned: 0 in 0.366s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.177s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a12e972b-c9a3-403a-a6e6-c5dab90d171e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19936e40-8996-4ead-b4f8-9d1681dd30fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:38 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Volume volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e (8f8848b5-f5f7-4f00-80ef-403b71bb4f5e): created successfully Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19936e40-8996-4ead-b4f8-9d1681dd30fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Flow 'volume_create_manager' (fb1ad991-f1ee-4ffb-87d5-7f6d416ea6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:38 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1a1148ae-17d0-45da-9b14-9592784ee2a4 tempest-VolumesSnapshotTestJSON-1546904908 None] Created volume successfully. Sep 29 18:44:38 devstack sudo[98266]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf" returned: 0 in 0.592s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2c399806-2679-421e-9c36-969d92354735(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[41705454-3e59-4725-8833-aeb26a7a9faf]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:38 devstack sudo[98269]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8bea6836-5532-40fe-b274-7cd22bb224e5" returned: 0 in 0.603s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8bea6836-5532-40fe-b274-7cd22bb224e5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:38 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735 Sep 29 18:44:38 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:38 devstack sudo[98282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8bea6836-5532-40fe-b274-7cd22bb224e5 Sep 29 18:44:38 devstack sudo[98282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:39 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735" returned: 0 in 0.479s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:39 devstack sudo[98288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf Sep 29 18:44:39 devstack sudo[98288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:39 devstack sudo[98282]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8bea6836-5532-40fe-b274-7cd22bb224e5" returned: 0 in 0.463s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Lock "cinder-quobyte-8bea6836-5532-40fe-b274-7cd22bb224e5" released by "delete_volume" :: held 1.128s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Created reservations ['702a35de-42bb-40a7-adc5-2fe281a0628e', '0b3ae5b4-b655-4338-99de-121db9df99d3', '9785e511-0312-4a87-ad0f-47d78805d959', 'ac4b85bf-538a-48d9-abb4-3f1ea2fd2d20'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:39 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:44:39 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:39 devstack sudo[98288]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] Creating offline snapshot bd42d476-b58c-4521-9d5d-b4bd0e916206 of volume 8f8848b5-f5f7-4f00-80ef-403b71bb4f5e {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf" returned: 0 in 0.512s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ab5b2f3-a8f4-462b-818e-caee802fe82c]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:39 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf Sep 29 18:44:39 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:39 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e Sep 29 18:44:39 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:39 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.310s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:39 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:44:39 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Deleted volume successfully. Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c6294a4e-770a-4dff-b10b-9aa5774dbe8a tempest-VolumesTestJSON-1724138377 None] Lock "cinder-8bea6836-5532-40fe-b274-7cd22bb224e5-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:40 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735.3765a807-9e81-49d6-a71a-c7eeff20d7bf" returned: 0 in 0.312s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-3765a807-9e81-49d6-a71a-c7eeff20d7bf" released by "_delete_snapshot" :: held 2.094s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-2c399806-2679-421e-9c36-969d92354735" released by "delete_snapshot" :: held 2.136s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:40 devstack cinder-volume[86523]: WARNING cinder.quota [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1369524202 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1369524202, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:44:40 devstack cinder-volume[86523]: WARNING cinder.quota [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1369524202 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1369524202, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] Created reservations ['d8fb095c-10df-4b15-8ecf-5f9033e85ad0', 'd6ff15aa-c358-4bb7-ae44-5ed9ede61320', '8d44f2e6-e10b-4755-99d4-6d6c088544d0', '319f5f88-0665-4f6e-9d8a-e770fcf59d07'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:40 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e" returned: 0 in 0.465s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:40 devstack sudo[98307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 1G Sep 29 18:44:40 devstack sudo[98307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:40 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-243cb921-b097-4fbc-be41-993fa2d0e2a6 tempest-GroupSnapshotsTest-1650590574 None] group_snapshot a0941f5b-18ac-46f7-8ae4-079973628a3f: deleted successfully Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Acquiring lock "cinder-61efb153-cebc-4305-b735-49d6a94bee2d-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Lock "cinder-61efb153-cebc-4305-b735-49d6a94bee2d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Acquiring lock "cinder-quobyte-61efb153-cebc-4305-b735-49d6a94bee2d" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Lock "cinder-quobyte-61efb153-cebc-4305-b735-49d6a94bee2d" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[33227946-e5a8-4642-a0ba-2dd981b2ea11]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61efb153-cebc-4305-b735-49d6a94bee2d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:40 devstack sudo[98309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61efb153-cebc-4305-b735-49d6a94bee2d Sep 29 18:44:40 devstack sudo[98309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:40 devstack sudo[98307]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 1G" returned: 0 in 0.533s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:40 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 Sep 29 18:44:40 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:40 devstack sudo[98309]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61efb153-cebc-4305-b735-49d6a94bee2d" returned: 0 in 0.415s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61efb153-cebc-4305-b735-49d6a94bee2d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:40 devstack sudo[98321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61efb153-cebc-4305-b735-49d6a94bee2d Sep 29 18:44:40 devstack sudo[98321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:41 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206" returned: 0 in 0.326s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:41 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 is being set with open permissions: ugo+rw Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:41 devstack sudo[98327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 Sep 29 18:44:41 devstack sudo[98327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:41 devstack sudo[98321]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61efb153-cebc-4305-b735-49d6a94bee2d" returned: 0 in 0.294s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Lock "cinder-quobyte-61efb153-cebc-4305-b735-49d6a94bee2d" released by "delete_volume" :: held 0.770s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Created reservations ['1ad04b45-0d8e-4e04-8366-cb11b9de8fc1', 'ebef081c-dc79-4fed-a107-ee113fece493', 'b6437eaf-8bfb-45cd-82c8-d8b981e6579b', '419cd204-74a7-4806-a673-15547c1645c1'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:41 devstack sudo[98327]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206" returned: 0 in 0.291s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:41 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:44:41 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:41 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.info Sep 29 18:44:41 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "cinder-quobyte-2c399806-2679-421e-9c36-969d92354735" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-2c399806-2679-421e-9c36-969d92354735" acquired by "delete_volume" :: waited 0.045s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:41 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.562s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:44:42 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Deleted volume successfully. Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bb1a7e-4897-46dd-8ae9-16812e37d1ff]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:42 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.info" returned: 0 in 0.572s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:42 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.info is being set with open permissions: ugo+rw Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a2267c51-fdb8-4e6a-bafd-2c1b067b3999 tempest-VolumesTestJSON-1724138377 None] Lock "cinder-61efb153-cebc-4305-b735-49d6a94bee2d-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:42 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.info Sep 29 18:44:42 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:42 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735 Sep 29 18:44:42 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:42 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.info" returned: 0 in 0.314s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.693s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:42 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-16aab657-958f-4819-b53a-ea4bf4110fe7 tempest-VolumesSnapshotTestJSON-1546904908 None] Create snapshot completed successfully Sep 29 18:44:42 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735" returned: 0 in 0.515s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:42 devstack sudo[98345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735 Sep 29 18:44:42 devstack sudo[98345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:42 devstack sudo[98345]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2c399806-2679-421e-9c36-969d92354735" returned: 0 in 0.303s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Lock "cinder-quobyte-2c399806-2679-421e-9c36-969d92354735" released by "delete_volume" :: held 0.946s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:42 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Created reservations ['107551a5-b23d-455f-81b9-c1b7b297b8d5'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:43 devstack cinder-volume[86523]: WARNING cinder.quota [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1369524202 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1369524202, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Created reservations ['3f32bd35-16ac-4d9e-a757-ca1f919fa3c8', '218bca25-8865-4e5a-9502-7aa6652624ff', 'da07dd96-e1a0-4de9-93fd-b25423085caf', '4d1b1e33-254d-4a5a-8a4c-9b73d6331c1e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:43 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:44:43 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:43 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.525s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:44:43 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-62ac0b27-f457-488c-883b-b0167c7fd7f3 tempest-GroupSnapshotsTest-1650590574 None] Delete group completed successfully. Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Flow 'volume_create_manager' (edf7e893-aa87-4368-a5e2-1abf7e4e75af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9395c709-fefe-499f-b497-4ea664d075da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9395c709-fefe-499f-b497-4ea664d075da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-377088259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9708e83d-cad0-4f57-8728-efbd94ae4a4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40efdd6f5e524e0cafd2caf708df5cb5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bd42d476-b58c-4521-9d5d-b4bd0e916206,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:44Z,use_quota=True,user_id='a36d45ab3e2f48769419289b16cf304e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8c4767-792e-4a42-9206-fb3f867c74c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f8c4767-792e-4a42-9206-fb3f867c74c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1922d47-59de-43df-b8aa-f108dfa80a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1922d47-59de-43df-b8aa-f108dfa80a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9708e83d-cad0-4f57-8728-efbd94ae4a4f', 'volume_name': 'volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f', 'volume_size': 1, 'snapshot_id': 'bd42d476-b58c-4521-9d5d-b4bd0e916206'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7960102-9929-4641-92c5-4cae178281e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7960102-9929-4641-92c5-4cae178281e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a577d490-6bb0-4f49-8736-07e817b1b282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:43 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Volume 9708e83d-cad0-4f57-8728-efbd94ae4a4f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f', 'volume_size': 1, 'snapshot_id': 'bd42d476-b58c-4521-9d5d-b4bd0e916206'} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-bd42d476-b58c-4521-9d5d-b4bd0e916206-9708e83d-cad0-4f57-8728-efbd94ae4a4f" by "_create_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-bd42d476-b58c-4521-9d5d-b4bd0e916206-9708e83d-cad0-4f57-8728-efbd94ae4a4f" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Creating volume 9708e83d-cad0-4f57-8728-efbd94ae4a4f from snapshot bd42d476-b58c-4521-9d5d-b4bd0e916206 {{(pid=86523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-9708e83d-cad0-4f57-8728-efbd94ae4a4f" by "_copy_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-9708e83d-cad0-4f57-8728-efbd94ae4a4f" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] snapshot: bd42d476-b58c-4521-9d5d-b4bd0e916206, volume: 9708e83d-cad0-4f57-8728-efbd94ae4a4f, {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:44:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:44 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f59232-abe1-440a-a8da-8b731725d18f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:44 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 Sep 29 18:44:44 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:44 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206" returned: 0 in 0.558s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:44:44 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d868b05-3186-4e0c-a8ad-fad8131e49a2]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:44 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e Sep 29 18:44:44 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:45 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e" returned: 0 in 0.474s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:44:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Creating direct copy from snapshot {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:44:45 devstack cinder-volume[86523]: DEBUG cinder.utils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Path /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f not found in is_blk_device check {{(pid=86523) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:44:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:45 devstack sudo[98363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f Sep 29 18:44:45 devstack sudo[98363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:49 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Flow 'volume_create_manager' (511e9e06-f2a6-4b5a-8903-ffed1d7d97f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a52184-6327-42e6-a5e7-1cd2a1dad815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a52184-6327-42e6-a5e7-1cd2a1dad815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1295426278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba10bf19b97e4e70a882b5144687724f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:49Z,use_quota=True,user_id='c35fa93292c04eb69d209878ded3fb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e5e048-d51d-4748-9e74-dfa26d40378d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e5e048-d51d-4748-9e74-dfa26d40378d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955953b6-4b12-46f0-a696-21aacc5ae210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (955953b6-4b12-46f0-a696-21aacc5ae210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e', 'volume_name': 'volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18be0436-574e-431b-8932-777ebb1d60fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18be0436-574e-431b-8932-777ebb1d60fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54927b40-ab1d-4298-adb8-da2b75cca607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:49 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Volume f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e', 'volume_size': 1} Sep 29 18:44:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:50 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Flow 'volume_create_manager' (b54042cf-1743-4b09-8c01-476b05769b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4086d215-de02-435d-880c-a4f92b3059e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4086d215-de02-435d-880c-a4f92b3059e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-182717391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d2ae15-72b9-457c-9eb4-b41f00dacc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba10bf19b97e4e70a882b5144687724f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:51Z,use_quota=True,user_id='c35fa93292c04eb69d209878ded3fb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a013f698-bee1-48cd-a9fe-09aebfc77f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a013f698-bee1-48cd-a9fe-09aebfc77f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851cd842-1a1d-41f7-bec7-53848c525c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (851cd842-1a1d-41f7-bec7-53848c525c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74d2ae15-72b9-457c-9eb4-b41f00dacc38', 'volume_name': 'volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8157d6e0-1267-4282-a6a0-42c42d64ce1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8157d6e0-1267-4282-a6a0-42c42d64ce1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d551c951-88d4-40ac-a6df-dffc40cee50d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:51 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Volume 74d2ae15-72b9-457c-9eb4-b41f00dacc38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38', 'volume_size': 1} Sep 29 18:44:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:55 devstack sudo[98363]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f" returned: 0 in 10.246s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e, size 1024.00 MB, duration 10.25 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:44:55 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Converted 1024.00 MB image at 99.93 MB/s Sep 29 18:44:55 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f is being set with open permissions: ugo+rw Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:55 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f Sep 29 18:44:55 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:55 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f" returned: 0 in 0.290s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-9708e83d-cad0-4f57-8728-efbd94ae4a4f" released by "_copy_volume_from_snapshot" :: held 11.697s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=195,cinder:INSERT=55,cinder:UPDATE=212,cinder:DELETE=15 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=228,cinder:SELECT=198,cinder:DELETE=12,cinder:INSERT=51 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-bd42d476-b58c-4521-9d5d-b4bd0e916206-9708e83d-cad0-4f57-8728-efbd94ae4a4f" released by "_create_volume_from_snapshot" :: held 11.822s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.847s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.143s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1295426278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba10bf19b97e4e70a882b5144687724f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:49Z,use_quota=True,user_id='c35fa93292c04eb69d209878ded3fb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Creating volume f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:55 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:55 devstack sudo[98418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e 1073741824 Sep 29 18:44:55 devstack sudo[98418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a577d490-6bb0-4f49-8736-07e817b1b282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f', 'volume_size': 1, 'snapshot_id': 'bd42d476-b58c-4521-9d5d-b4bd0e916206'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c495f69d-d78d-4ecf-b9b3-791944a1cfd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:55 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Volume volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f (9708e83d-cad0-4f57-8728-efbd94ae4a4f): created successfully Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c495f69d-d78d-4ecf-b9b3-791944a1cfd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:55 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Flow 'volume_create_manager' (edf7e893-aa87-4368-a5e2-1abf7e4e75af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:55 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d8a24bb0-cf06-4a04-9491-9139c3b980ce tempest-VolumesSnapshotTestJSON-1546904908 None] Created volume successfully. Sep 29 18:44:56 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6300577c-e64e-44b7-83a7-5351aabca797 tempest-GroupSnapshotsV319Test-624338434 None] Group tempest-GroupSnapshotsV319Test-Group-1711858641: creating Sep 29 18:44:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-9708e83d-cad0-4f57-8728-efbd94ae4a4f-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:56 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6300577c-e64e-44b7-83a7-5351aabca797 tempest-GroupSnapshotsV319Test-624338434 None] Group tempest-GroupSnapshotsV319Test-Group-1711858641: created successfully Sep 29 18:44:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-9708e83d-cad0-4f57-8728-efbd94ae4a4f-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:56 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6300577c-e64e-44b7-83a7-5351aabca797 tempest-GroupSnapshotsV319Test-624338434 None] Create group completed successfully. Sep 29 18:44:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-9708e83d-cad0-4f57-8728-efbd94ae4a4f" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:56 devstack sudo[98418]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e 1073741824" returned: 0 in 0.777s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-9708e83d-cad0-4f57-8728-efbd94ae4a4f" acquired by "delete_volume" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:56 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[72103555-31ff-4935-adc0-5d69c1a23840]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:56 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e Sep 29 18:44:56 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:56 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f Sep 29 18:44:56 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:57 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e" returned: 0 in 0.317s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.975s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-182717391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74d2ae15-72b9-457c-9eb4-b41f00dacc38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba10bf19b97e4e70a882b5144687724f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:51Z,use_quota=True,user_id='c35fa93292c04eb69d209878ded3fb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Creating volume 74d2ae15-72b9-457c-9eb4-b41f00dacc38 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:57 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54927b40-ab1d-4298-adb8-da2b75cca607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70935874-3e0b-452f-9960-37fcf1560e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:57 devstack sudo[98434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38 1073741824 Sep 29 18:44:57 devstack sudo[98434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:57 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Volume volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e (f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e): created successfully Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70935874-3e0b-452f-9960-37fcf1560e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Flow 'volume_create_manager' (511e9e06-f2a6-4b5a-8903-ffed1d7d97f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:57 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7b185999-d793-43e5-a7d2-4aa416638c40 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Created volume successfully. Sep 29 18:44:57 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f" returned: 0 in 0.528s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:57 devstack sudo[98438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f Sep 29 18:44:57 devstack sudo[98438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:57 devstack sudo[98438]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9708e83d-cad0-4f57-8728-efbd94ae4a4f" returned: 0 in 0.375s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-9708e83d-cad0-4f57-8728-efbd94ae4a4f" released by "delete_volume" :: held 0.969s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Created reservations ['ac5abd39-f494-4f32-80db-61e7f93b7bc9', '1e7942a9-125e-4b63-81e5-4b5706c0373f', '74ad9d3a-0826-4f0a-baa5-2d1991c13cdd', 'a1719099-135e-4779-bb19-9ad7389f039c'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:44:57 devstack sudo[98434]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38 1073741824" returned: 0 in 0.677s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:57 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38 Sep 29 18:44:57 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:57 devstack sudo[98446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:44:57 devstack sudo[98446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:58 devstack sudo[98446]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.365s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:44:58 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Deleted volume successfully. Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fb02d1ec-8fd2-430c-895b-9f80351d24e5 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-9708e83d-cad0-4f57-8728-efbd94ae4a4f-delete_volume" released by "delete_volume" :: held 1.734s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:44:58 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38" returned: 0 in 0.582s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d551c951-88d4-40ac-a6df-dffc40cee50d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e265ec8b-35f7-4e0d-a767-bb57f5ae5ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:58 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Volume volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38 (74d2ae15-72b9-457c-9eb4-b41f00dacc38): created successfully Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e265ec8b-35f7-4e0d-a767-bb57f5ae5ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Flow 'volume_create_manager' (b54042cf-1743-4b09-8c01-476b05769b3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:58 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d66354f3-5855-46c5-a1a3-1d61d9867e4b tempest-TestServerVolumeAttachmentScenario-2127854079 None] Created volume successfully. Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:58 devstack sudo[98451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:44:58 devstack sudo[98451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Flow 'volume_create_manager' (ba7239e7-3741-49fb-9b22-235f05a57ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18d429c-0b64-49a2-89d3-b3574b5ce7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b18d429c-0b64-49a2-89d3-b3574b5ce7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1539322135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a76d3da1-ea1e-438f-a80a-bdb10817cee9,host='devstack@QuobyteHD#QuobyteHD',id=f5d9db8f-67ff-4d07-a75d-f0879af601c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce6c22cb9d54128afd7c6b46d412732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:59Z,use_quota=True,user_id='89f86353c6564941aabf4ede7d399c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(681ba7a7-c18d-4cbd-97e8-5b12edfc3a57),volume_type_id=681ba7a7-c18d-4cbd-97e8-5b12edfc3a57)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c900c79e-6674-4694-918d-f38c19a15a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c900c79e-6674-4694-918d-f38c19a15a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d22d31e-d07d-47e1-b88c-d13ba8f7b3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d22d31e-d07d-47e1-b88c-d13ba8f7b3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5d9db8f-67ff-4d07-a75d-f0879af601c0', 'volume_name': 'volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1b9bde-f035-4d8d-9109-daf0b5b9ad52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1b9bde-f035-4d8d-9109-daf0b5b9ad52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bbd566-f0f1-4b46-9840-9e37d5150429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:44:58 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Volume f5d9db8f-67ff-4d07-a75d-f0879af601c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0', 'volume_size': 1} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a76d3da1-ea1e-438f-a80a-bdb10817cee9,created_at=2026-09-29T16:44:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1539322135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a76d3da1-ea1e-438f-a80a-bdb10817cee9,host='devstack@QuobyteHD#QuobyteHD',id=f5d9db8f-67ff-4d07-a75d-f0879af601c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ce6c22cb9d54128afd7c6b46d412732',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:44:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:44:59Z,use_quota=True,user_id='89f86353c6564941aabf4ede7d399c01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(681ba7a7-c18d-4cbd-97e8-5b12edfc3a57),volume_type_id=681ba7a7-c18d-4cbd-97e8-5b12edfc3a57)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Creating volume f5d9db8f-67ff-4d07-a75d-f0879af601c0 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:44:58 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:58 devstack sudo[98456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 1073741824 Sep 29 18:44:58 devstack sudo[98456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-bd42d476-b58c-4521-9d5d-b4bd0e916206-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-bd42d476-b58c-4521-9d5d-b4bd0e916206-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:59 devstack sudo[98451]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-bd42d476-b58c-4521-9d5d-b4bd0e916206" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.477s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-bd42d476-b58c-4521-9d5d-b4bd0e916206" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Deleting offline snapshot bd42d476-b58c-4521-9d5d-b4bd0e916206 of volume 8f8848b5-f5f7-4f00-80ef-403b71bb4f5e {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] snapshot_file for this snap is: volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce8401d-a5a0-4308-aa13-32e2b7be393d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:59 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 Sep 29 18:44:59 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:59 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206" returned: 0 in 0.611s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:44:59 devstack sudo[98456]: pam_unix(sudo:session): session closed for user root Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 1073741824" returned: 0 in 0.977s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c4e79b-409b-43a0-968e-9db248096442]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:44:59 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 Sep 29 18:44:59 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:44:59 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e Sep 29 18:44:59 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:00 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0" returned: 0 in 0.288s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] <== create_volume: return (1352ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:45:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35bbd566-f0f1-4b46-9840-9e37d5150429) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d570b76-24bb-427f-a3fc-3c69952d2a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:00 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Volume volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 (f5d9db8f-67ff-4d07-a75d-f0879af601c0): created successfully Sep 29 18:45:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d570b76-24bb-427f-a3fc-3c69952d2a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Flow 'volume_create_manager' (ba7239e7-3741-49fb-9b22-235f05a57ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:45:00 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4d2d49cc-36bb-443a-9c03-cef141101988 tempest-GroupSnapshotsV319Test-624338434 None] Created volume successfully. Sep 29 18:45:00 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e" returned: 0 in 0.691s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:00 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 Sep 29 18:45:00 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:00 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206" returned: 0 in 0.387s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:00 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206 Sep 29 18:45:00 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:01 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-aadd9ee8-28c1-4bcd-b018-4ae8d0592f7d tempest-GroupsTest-67699812 None] Group tempest-Group1-624697224: creating Sep 29 18:45:01 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-aadd9ee8-28c1-4bcd-b018-4ae8d0592f7d tempest-GroupsTest-67699812 None] Group tempest-Group1-624697224: created successfully Sep 29 18:45:01 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-aadd9ee8-28c1-4bcd-b018-4ae8d0592f7d tempest-GroupsTest-67699812 None] Create group completed successfully. Sep 29 18:45:01 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e.bd42d476-b58c-4521-9d5d-b4bd0e916206" returned: 0 in 0.349s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-bd42d476-b58c-4521-9d5d-b4bd0e916206" released by "_delete_snapshot" :: held 2.187s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e" released by "delete_snapshot" :: held 2.244s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:01 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Created reservations ['fe115660-bc6b-4992-abbd-e81cf8e45800', '9b9465ee-a5df-4c16-9bbf-f8c06948221a', '851402eb-00c7-4ddc-bf4e-cddb7cd44c97', '930a8c64-53b4-4051-aedd-654723ab4c3c'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:01 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] GroupSnapshot cec495d6-66a8-4d69-abb3-f3a55eb9f962: creating. Sep 29 18:45:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] Group snapshot cec495d6-66a8-4d69-abb3-f3a55eb9f962: creating. {{(pid=86523) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4215}} Sep 29 18:45:01 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Delete snapshot completed successfully. Sep 29 18:45:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0c86d1ae-a4a0-4793-aa22-37244feb521a tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-bd42d476-b58c-4521-9d5d-b4bd0e916206-delete_snapshot" released by "delete_snapshot" :: held 2.505s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] Creating offline snapshot 97731b27-c310-427a-8a3c-3c5dbfc9627f of volume f5d9db8f-67ff-4d07-a75d-f0879af601c0 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:45:01 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[268b6f4d-7eb3-4dfe-ae65-5402fec0a8a1]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:01 devstack sudo[98508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 Sep 29 18:45:01 devstack sudo[98508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:02 devstack sudo[98508]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0" returned: 0 in 0.609s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:02 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f 1G Sep 29 18:45:02 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:02 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ec1861a2-54a9-468c-bdf2-125f9861523f tempest-GroupsTest-67699812 None] Group tempest-Group2-1814444563: creating Sep 29 18:45:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e" acquired by "delete_volume" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:02 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d08984-4c2d-47ab-a12b-ae6a6fcecc61]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:02 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ec1861a2-54a9-468c-bdf2-125f9861523f tempest-GroupsTest-67699812 None] Group tempest-Group2-1814444563: created successfully Sep 29 18:45:02 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ec1861a2-54a9-468c-bdf2-125f9861523f tempest-GroupsTest-67699812 None] Create group completed successfully. Sep 29 18:45:02 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e Sep 29 18:45:02 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:03 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f 1G" returned: 0 in 0.877s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:03 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f Sep 29 18:45:03 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:03 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e" returned: 0 in 0.506s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:03 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e Sep 29 18:45:03 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:03 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f" returned: 0 in 0.354s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:03 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:03 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f Sep 29 18:45:03 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:03 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e" returned: 0 in 0.277s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e" released by "delete_volume" :: held 0.894s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Created reservations ['e7732868-6acc-4126-9714-934ed437ec44', '756066c1-ec51-4851-ae6b-0e82012e1a3d', 'ee36c09c-294b-4ce0-9ea8-cf23358ac7f0', '61a5ad14-b8df-4819-8518-59e6be511e68'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:03 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f" returned: 0 in 0.316s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:03 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.info Sep 29 18:45:03 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:03 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:45:03 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:04 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.info" returned: 0 in 0.321s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:04 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:04 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.336s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:45:04 devstack sudo[98625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.info Sep 29 18:45:04 devstack sudo[98625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:04 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Deleted volume successfully. Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ccf9c585-9dc9-423f-acc4-d59f7a861494 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-8f8848b5-f5f7-4f00-80ef-403b71bb4f5e-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.info" returned: 0 in 0.333s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:04 devstack sudo[98625]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.995s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Flow 'volume_create_manager' (d2d307cf-12f5-4171-961c-b54e69f5aa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f86535-980c-4a07-9757-36d5a2b40bf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7f86535-980c-4a07-9757-36d5a2b40bf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1880784454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c64ad4a6-6c57-4927-b77c-535fa8f1ecb6,host='devstack@QuobyteHD#QuobyteHD',id=b18188bd-18b3-4384-8932-b103eb305e82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e32ddc51a874dcbb9cef9b7099b4ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:45:05Z,use_quota=True,user_id='17ad60589a3a4674b017dfcbb8c3935e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2105170-c1bd-4824-99cb-9e4bf77384e4),volume_type_id=e2105170-c1bd-4824-99cb-9e4bf77384e4)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e214e155-f1ba-41fd-ad35-cd477f545fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e214e155-f1ba-41fd-ad35-cd477f545fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35f6a9f-16bc-4281-854d-f06f00af5cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d35f6a9f-16bc-4281-854d-f06f00af5cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b18188bd-18b3-4384-8932-b103eb305e82', 'volume_name': 'volume-b18188bd-18b3-4384-8932-b103eb305e82', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213ad78f-1cd4-4be5-a574-c09e483e0bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (213ad78f-1cd4-4be5-a574-c09e483e0bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d71754-e8a8-4dd4-8408-9f737f356f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:04 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Volume b18188bd-18b3-4384-8932-b103eb305e82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b18188bd-18b3-4384-8932-b103eb305e82', 'volume_size': 1} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c64ad4a6-6c57-4927-b77c-535fa8f1ecb6,created_at=2026-09-29T16:45:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1880784454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c64ad4a6-6c57-4927-b77c-535fa8f1ecb6,host='devstack@QuobyteHD#QuobyteHD',id=b18188bd-18b3-4384-8932-b103eb305e82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e32ddc51a874dcbb9cef9b7099b4ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:45:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:45:05Z,use_quota=True,user_id='17ad60589a3a4674b017dfcbb8c3935e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e2105170-c1bd-4824-99cb-9e4bf77384e4),volume_type_id=e2105170-c1bd-4824-99cb-9e4bf77384e4)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Creating volume b18188bd-18b3-4384-8932-b103eb305e82 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:45:04 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:45:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b18188bd-18b3-4384-8932-b103eb305e82 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:04 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7968caba-4e40-4d31-8f64-f1374196d36a tempest-GroupSnapshotsV319Test-624338434 None] group_snapshot cec495d6-66a8-4d69-abb3-f3a55eb9f962: created successfully Sep 29 18:45:04 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b18188bd-18b3-4384-8932-b103eb305e82 1073741824 Sep 29 18:45:04 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-f9a4c466-240a-401a-81a7-55559aedcc9d-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-f9a4c466-240a-401a-81a7-55559aedcc9d-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "cinder-quobyte-f9a4c466-240a-401a-81a7-55559aedcc9d" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-f9a4c466-240a-401a-81a7-55559aedcc9d" acquired by "delete_volume" :: waited 0.038s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[81913d15-dd76-45fb-85b5-1def00afdbb2]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:05 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] group_snapshot cec495d6-66a8-4d69-abb3-f3a55eb9f962: deleting Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] group_snapshot cec495d6-66a8-4d69-abb3-f3a55eb9f962: deleting {{(pid=86523) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4390}} Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Acquiring lock "cinder-quobyte-f5d9db8f-67ff-4d07-a75d-f0879af601c0" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Lock "cinder-quobyte-f5d9db8f-67ff-4d07-a75d-f0879af601c0" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Acquiring lock "cinder-quobyte-97731b27-c310-427a-8a3c-3c5dbfc9627f" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Lock "cinder-quobyte-97731b27-c310-427a-8a3c-3c5dbfc9627f" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:05 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d Sep 29 18:45:05 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Deleting offline snapshot 97731b27-c310-427a-8a3c-3c5dbfc9627f of volume f5d9db8f-67ff-4d07-a75d-f0879af601c0 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] snapshot_file for this snap is: volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[03eadf3b-cb39-4d77-8aba-cba2376c040d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:05 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b18188bd-18b3-4384-8932-b103eb305e82 1073741824" returned: 0 in 1.075s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:05 devstack sudo[98637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f Sep 29 18:45:05 devstack sudo[98637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b18188bd-18b3-4384-8932-b103eb305e82 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:06 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b18188bd-18b3-4384-8932-b103eb305e82 Sep 29 18:45:06 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:06 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d" returned: 0 in 0.696s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:06 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d Sep 29 18:45:06 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:06 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b18188bd-18b3-4384-8932-b103eb305e82" returned: 0 in 0.305s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4d71754-e8a8-4dd4-8408-9f737f356f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b18188bd-18b3-4384-8932-b103eb305e82', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:06 devstack sudo[98637]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272c9c64-0dd4-48df-bb24-5a872f1a9600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f" returned: 0 in 0.570s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:45:06 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Volume volume-b18188bd-18b3-4384-8932-b103eb305e82 (b18188bd-18b3-4384-8932-b103eb305e82): created successfully Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (272c9c64-0dd4-48df-bb24-5a872f1a9600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Flow 'volume_create_manager' (d2d307cf-12f5-4171-961c-b54e69f5aa81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e68b1ff-df1e-47ad-8b49-f62945df6e40]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:06 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-430f8809-fdd2-4c31-ad1c-d1eb050b82e3 tempest-GroupsTest-67699812 None] Created volume successfully. Sep 29 18:45:06 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f9a4c466-240a-401a-81a7-55559aedcc9d" returned: 0 in 0.357s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-quobyte-f9a4c466-240a-401a-81a7-55559aedcc9d" released by "delete_volume" :: held 1.187s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:06 devstack sudo[98650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 Sep 29 18:45:06 devstack sudo[98650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Created reservations ['544ac378-e922-4a8b-858d-557e78ff40b8', '859fb88f-fda2-4acc-9d2c-7f412bf3d6a7', '531ba2a3-f8a2-4322-b820-870ec518f778', 'f077fc86-9053-4827-bd51-33c675aae43c'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:06 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:45:06 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:06 devstack sudo[98650]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0" returned: 0 in 0.506s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:06 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f Sep 29 18:45:06 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:07 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.361s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:07 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:45:07 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Deleted volume successfully. Sep 29 18:45:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1ae251e3-4585-423d-a4db-d47c3df3edf2 tempest-VolumesSnapshotTestJSON-1546904908 None] Lock "cinder-f9a4c466-240a-401a-81a7-55559aedcc9d-delete_volume" released by "delete_volume" :: held 1.926s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:07 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f" returned: 0 in 0.618s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:07 devstack sudo[98664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f Sep 29 18:45:07 devstack sudo[98664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:07 devstack sudo[98664]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0.97731b27-c310-427a-8a3c-3c5dbfc9627f" returned: 0 in 0.455s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Lock "cinder-quobyte-97731b27-c310-427a-8a3c-3c5dbfc9627f" released by "_delete_snapshot" :: held 2.326s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Lock "cinder-quobyte-f5d9db8f-67ff-4d07-a75d-f0879af601c0" released by "delete_snapshot" :: held 2.362s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Acquiring lock "cinder-quobyte-b18188bd-18b3-4384-8932-b103eb305e82" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Lock "cinder-quobyte-b18188bd-18b3-4384-8932-b103eb305e82" acquired by "delete_volume" :: waited 0.042s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:08 devstack cinder-volume[86523]: WARNING cinder.quota [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-256592930 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-256592930, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:45:08 devstack cinder-volume[86523]: WARNING cinder.quota [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-256592930 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-256592930, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:45:08 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] Created reservations ['bfeb8673-8d06-4551-b710-3cf7ad13e969', '21766897-9767-446c-afbf-c7c90e9a4bfe', 'af9af7f3-4b5a-4ba2-870c-0d45c4da02ef', 'e142d206-23ea-471a-8ab4-45ca626dc6dd'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:08 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[af56f35b-33e7-485e-84bd-ccda67b23b4a]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b18188bd-18b3-4384-8932-b103eb305e82 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:08 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e7cdf3e7-c3e0-4943-97ce-58140746af6f tempest-GroupSnapshotsV319Test-624338434 None] group_snapshot cec495d6-66a8-4d69-abb3-f3a55eb9f962: deleted successfully Sep 29 18:45:08 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b18188bd-18b3-4384-8932-b103eb305e82 Sep 29 18:45:08 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:08 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b18188bd-18b3-4384-8932-b103eb305e82" returned: 0 in 0.545s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b18188bd-18b3-4384-8932-b103eb305e82 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:08 devstack sudo[98674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b18188bd-18b3-4384-8932-b103eb305e82 Sep 29 18:45:08 devstack sudo[98674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:09 devstack sudo[98674]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b18188bd-18b3-4384-8932-b103eb305e82" returned: 0 in 0.354s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Lock "cinder-quobyte-b18188bd-18b3-4384-8932-b103eb305e82" released by "delete_volume" :: held 1.010s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Created reservations ['ad06d0dd-e10d-476e-a34f-c276180e939e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:09 devstack cinder-volume[86523]: WARNING cinder.quota [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1756341416 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1756341416, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:45:09 devstack cinder-volume[86523]: WARNING cinder.quota [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1756341416 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1756341416, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Created reservations ['a3a7713f-c819-4de3-a900-434abeaef6d5', 'f31c25fc-af52-47ae-a967-6fba552c93cd', '1cca44e4-a1e4-4718-bd6d-fe021d5f26ca', '5688f165-0ce7-4a3e-9eac-80660b5cc1d3'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Acquiring lock "cinder-quobyte-f5d9db8f-67ff-4d07-a75d-f0879af601c0" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:09 devstack sudo[98678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:45:09 devstack sudo[98678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Lock "cinder-quobyte-f5d9db8f-67ff-4d07-a75d-f0879af601c0" acquired by "delete_volume" :: waited 0.048s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1359273-d433-4f40-8407-f09210b755c2]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:10 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 Sep 29 18:45:10 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:10 devstack sudo[98678]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.487s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:45:10 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-0f48d7af-694d-445b-b3a8-1950aedaeaa8 tempest-GroupsTest-67699812 None] Delete group completed successfully. Sep 29 18:45:10 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0" returned: 0 in 0.574s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:10 devstack sudo[98688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0 Sep 29 18:45:10 devstack sudo[98688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:10 devstack sudo[98688]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f5d9db8f-67ff-4d07-a75d-f0879af601c0" returned: 0 in 0.324s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Lock "cinder-quobyte-f5d9db8f-67ff-4d07-a75d-f0879af601c0" released by "delete_volume" :: held 1.017s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Created reservations ['7a078895-5b76-48af-b394-3dabe16ad11d'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-bd12e140-fbcd-4d16-a293-3eda8946ab9e tempest-GroupsTest-67699812 None] Created reservations ['8891d50c-fec7-4a55-b8e6-c0768f89dc73'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:10 devstack cinder-volume[86523]: WARNING cinder.quota [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-256592930 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-256592930, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bd12e140-fbcd-4d16-a293-3eda8946ab9e tempest-GroupsTest-67699812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bd12e140-fbcd-4d16-a293-3eda8946ab9e tempest-GroupsTest-67699812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bd12e140-fbcd-4d16-a293-3eda8946ab9e tempest-GroupsTest-67699812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bd12e140-fbcd-4d16-a293-3eda8946ab9e tempest-GroupsTest-67699812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bd12e140-fbcd-4d16-a293-3eda8946ab9e tempest-GroupsTest-67699812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bd12e140-fbcd-4d16-a293-3eda8946ab9e tempest-GroupsTest-67699812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:11 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Created reservations ['8a5868ed-08ae-4ef0-aaad-dc842594742b', 'f7e8bdb8-ec39-4787-b443-01d385856a09', 'bf4b924e-41fa-445c-b755-244ec841cf81', 'f3f3e19d-ba9a-41d0-96ac-609051bddace'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:11 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:45:11 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:11 devstack sudo[98693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:45:11 devstack sudo[98693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:11 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bd12e140-fbcd-4d16-a293-3eda8946ab9e tempest-GroupsTest-67699812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.551s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:11 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-bd12e140-fbcd-4d16-a293-3eda8946ab9e tempest-GroupsTest-67699812 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:45:11 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-bd12e140-fbcd-4d16-a293-3eda8946ab9e tempest-GroupsTest-67699812 None] Delete group completed successfully. Sep 29 18:45:11 devstack sudo[98693]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.356s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:11 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:45:11 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-85026c83-98d5-4bc7-8e31-a533d22e5d30 tempest-GroupSnapshotsV319Test-624338434 None] Delete group completed successfully. Sep 29 18:45:12 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3296a104-47f9-4189-a626-8accdf08e9b0 tempest-GroupsTest-67699812 None] Group tempest-GroupsTest-Group-538235933: creating Sep 29 18:45:12 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3296a104-47f9-4189-a626-8accdf08e9b0 tempest-GroupsTest-67699812 None] Group tempest-GroupsTest-Group-538235933: created successfully Sep 29 18:45:12 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3296a104-47f9-4189-a626-8accdf08e9b0 tempest-GroupsTest-67699812 None] Create group completed successfully. Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Flow 'volume_create_manager' (a8f3331b-c11c-4953-93c5-25270b1776f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560ed8c9-4eee-4c6d-8912-e8d390ef66fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560ed8c9-4eee-4c6d-8912-e8d390ef66fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382248005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=075f8285-85da-4eb6-9123-905c3811e2f4,host='devstack@QuobyteHD#QuobyteHD',id=5ef34113-bcab-4b26-a602-72e3caf13c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e32ddc51a874dcbb9cef9b7099b4ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:45:15Z,use_quota=True,user_id='17ad60589a3a4674b017dfcbb8c3935e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1fc3345-fca2-45eb-9ca3-f01022f3bee2),volume_type_id=d1fc3345-fca2-45eb-9ca3-f01022f3bee2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409759ff-1153-484f-b002-24aad9af621b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (409759ff-1153-484f-b002-24aad9af621b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b3b41d-499b-4b1b-96a7-8480143b9e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15b3b41d-499b-4b1b-96a7-8480143b9e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ef34113-bcab-4b26-a602-72e3caf13c91', 'volume_name': 'volume-5ef34113-bcab-4b26-a602-72e3caf13c91', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa4b6d5-8e9e-4e4c-81fb-e0cf2a8a02b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa4b6d5-8e9e-4e4c-81fb-e0cf2a8a02b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18f2c34-8f9b-41d8-98f9-d81bced605ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:14 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Volume 5ef34113-bcab-4b26-a602-72e3caf13c91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ef34113-bcab-4b26-a602-72e3caf13c91', 'volume_size': 1} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=075f8285-85da-4eb6-9123-905c3811e2f4,created_at=2026-09-29T16:45:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1382248005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=075f8285-85da-4eb6-9123-905c3811e2f4,host='devstack@QuobyteHD#QuobyteHD',id=5ef34113-bcab-4b26-a602-72e3caf13c91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e32ddc51a874dcbb9cef9b7099b4ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:45:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:45:15Z,use_quota=True,user_id='17ad60589a3a4674b017dfcbb8c3935e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1fc3345-fca2-45eb-9ca3-f01022f3bee2),volume_type_id=d1fc3345-fca2-45eb-9ca3-f01022f3bee2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Creating volume 5ef34113-bcab-4b26-a602-72e3caf13c91 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:45:14 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:45:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5ef34113-bcab-4b26-a602-72e3caf13c91 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:14 devstack sudo[98700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5ef34113-bcab-4b26-a602-72e3caf13c91 1073741824 Sep 29 18:45:14 devstack sudo[98700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:15 devstack sudo[98700]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5ef34113-bcab-4b26-a602-72e3caf13c91 1073741824" returned: 0 in 0.638s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5ef34113-bcab-4b26-a602-72e3caf13c91 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:15 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5ef34113-bcab-4b26-a602-72e3caf13c91 Sep 29 18:45:15 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:15 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5ef34113-bcab-4b26-a602-72e3caf13c91" returned: 0 in 0.318s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:45:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18f2c34-8f9b-41d8-98f9-d81bced605ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ef34113-bcab-4b26-a602-72e3caf13c91', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef90523-c68d-4da9-adfc-729cf4a1c377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:15 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Volume volume-5ef34113-bcab-4b26-a602-72e3caf13c91 (5ef34113-bcab-4b26-a602-72e3caf13c91): created successfully Sep 29 18:45:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ef90523-c68d-4da9-adfc-729cf4a1c377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Flow 'volume_create_manager' (a8f3331b-c11c-4953-93c5-25270b1776f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:45:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-bffc9d2c-91e4-4913-ad59-213e62800a1c tempest-GroupsTest-67699812 None] Created volume successfully. Sep 29 18:45:17 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Flow 'volume_create_manager' (35e17aa0-8e6d-4631-862e-a46e37df9978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d8b88d-b4f1-4964-96b7-ebabf4bc85aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8d8b88d-b4f1-4964-96b7-ebabf4bc85aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1917452980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=075f8285-85da-4eb6-9123-905c3811e2f4,host='devstack@QuobyteHD#QuobyteHD',id=8c76bb9e-c87a-414a-a38c-cf76d33f55bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e32ddc51a874dcbb9cef9b7099b4ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:45:18Z,use_quota=True,user_id='17ad60589a3a4674b017dfcbb8c3935e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1fc3345-fca2-45eb-9ca3-f01022f3bee2),volume_type_id=d1fc3345-fca2-45eb-9ca3-f01022f3bee2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526740e0-e9a1-4716-98fe-9295c12dfc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (526740e0-e9a1-4716-98fe-9295c12dfc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16898ee5-e315-4598-9704-9d929587b3d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16898ee5-e315-4598-9704-9d929587b3d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c76bb9e-c87a-414a-a38c-cf76d33f55bc', 'volume_name': 'volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2b3c72-3179-45eb-a383-4a82452e9b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2b3c72-3179-45eb-a383-4a82452e9b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647277f2-094a-4808-9b45-09b73f767316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:18 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Volume 8c76bb9e-c87a-414a-a38c-cf76d33f55bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc', 'volume_size': 1} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=075f8285-85da-4eb6-9123-905c3811e2f4,created_at=2026-09-29T16:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1917452980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=075f8285-85da-4eb6-9123-905c3811e2f4,host='devstack@QuobyteHD#QuobyteHD',id=8c76bb9e-c87a-414a-a38c-cf76d33f55bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e32ddc51a874dcbb9cef9b7099b4ef5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:45:18Z,use_quota=True,user_id='17ad60589a3a4674b017dfcbb8c3935e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1fc3345-fca2-45eb-9ca3-f01022f3bee2),volume_type_id=d1fc3345-fca2-45eb-9ca3-f01022f3bee2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Creating volume 8c76bb9e-c87a-414a-a38c-cf76d33f55bc {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:45:18 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:18 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc 1073741824 Sep 29 18:45:18 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:18 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc 1073741824" returned: 0 in 0.522s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:18 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc Sep 29 18:45:18 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:18 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc" returned: 0 in 0.292s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (647277f2-094a-4808-9b45-09b73f767316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92065ec8-a298-4635-b2a3-ce6002ee369d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:18 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Volume volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc (8c76bb9e-c87a-414a-a38c-cf76d33f55bc): created successfully Sep 29 18:45:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92065ec8-a298-4635-b2a3-ce6002ee369d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Flow 'volume_create_manager' (35e17aa0-8e6d-4631-862e-a46e37df9978) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:45:19 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-5d084eb8-7453-458f-9c88-b86aa9b1702c tempest-GroupsTest-67699812 None] Created volume successfully. Sep 29 18:45:19 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-711db227-1a0f-4393-adc8-fc822d177508 tempest-GroupsTest-67699812 None] Update group completed successfully. Sep 29 18:45:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-652bce7b-0913-4360-b616-6a807b608fbe tempest-GroupsV314Test-1355868593 None] Group tempest-GroupsV314Test-Group-1102667735: creating Sep 29 18:45:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-652bce7b-0913-4360-b616-6a807b608fbe tempest-GroupsV314Test-1355868593 None] Group tempest-GroupsV314Test-Group-1102667735: created successfully Sep 29 18:45:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-652bce7b-0913-4360-b616-6a807b608fbe tempest-GroupsV314Test-1355868593 None] Create group completed successfully. Sep 29 18:45:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-03dfb156-675f-4fcc-a8f0-f28dafb705b5 tempest-GroupsTest-67699812 None] Update group completed successfully. Sep 29 18:45:21 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:45:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Flow 'volume_create_manager' (8039b708-48da-4b02-9dff-1931a9f4c99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:45:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266d388d-aaec-42a3-86ab-69b639a7081e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (266d388d-aaec-42a3-86ab-69b639a7081e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-170364013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4418f02e-8d57-4fe7-8076-c33df4579812,host='devstack@QuobyteHD#QuobyteHD',id=ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304d9018fb4449ea8422b88182058412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:45:22Z,use_quota=True,user_id='33424e286d454dbb9b61dbf2d859cc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adb15dac-c123-4376-ac2c-03748afecbcd),volume_type_id=adb15dac-c123-4376-ac2c-03748afecbcd)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53dd423-052c-436e-902c-485d893c3494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a53dd423-052c-436e-902c-485d893c3494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd6f865-a9fa-458e-8ca5-08a3fd63224b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7fd6f865-a9fa-458e-8ca5-08a3fd63224b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c', 'volume_name': 'volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c962d52c-0568-401f-812a-6f2c398c7b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c962d52c-0568-401f-812a-6f2c398c7b03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9316939a-27e1-4aa2-8fc1-6ad028ceeb1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:22 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Volume ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c', 'volume_size': 1} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4418f02e-8d57-4fe7-8076-c33df4579812,created_at=2026-09-29T16:45:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-170364013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4418f02e-8d57-4fe7-8076-c33df4579812,host='devstack@QuobyteHD#QuobyteHD',id=ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304d9018fb4449ea8422b88182058412',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:45:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:45:22Z,use_quota=True,user_id='33424e286d454dbb9b61dbf2d859cc9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(adb15dac-c123-4376-ac2c-03748afecbcd),volume_type_id=adb15dac-c123-4376-ac2c-03748afecbcd)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Creating volume ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:45:22 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:22 devstack sudo[98741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c 1073741824 Sep 29 18:45:22 devstack sudo[98741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Acquiring lock "cinder-quobyte-5ef34113-bcab-4b26-a602-72e3caf13c91" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Lock "cinder-quobyte-5ef34113-bcab-4b26-a602-72e3caf13c91" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[739cc161-4aa0-4007-98cf-1fb80855c607]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5ef34113-bcab-4b26-a602-72e3caf13c91 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:22 devstack sudo[98741]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c 1073741824" returned: 0 in 0.602s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:22 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c Sep 29 18:45:22 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:22 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5ef34113-bcab-4b26-a602-72e3caf13c91 Sep 29 18:45:22 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:23 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c" returned: 0 in 0.297s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] <== create_volume: return (958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9316939a-27e1-4aa2-8fc1-6ad028ceeb1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb4bf0c-42a1-46f1-882a-648c50cfb274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:23 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Volume volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c (ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c): created successfully Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cb4bf0c-42a1-46f1-882a-648c50cfb274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Flow 'volume_create_manager' (8039b708-48da-4b02-9dff-1931a9f4c99b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:45:23 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2635193b-74a1-480a-926c-21c25814ea70 tempest-GroupsV314Test-1355868593 None] Created volume successfully. Sep 29 18:45:23 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5ef34113-bcab-4b26-a602-72e3caf13c91" returned: 0 in 0.501s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5ef34113-bcab-4b26-a602-72e3caf13c91 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:23 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5ef34113-bcab-4b26-a602-72e3caf13c91 Sep 29 18:45:23 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:23 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5ef34113-bcab-4b26-a602-72e3caf13c91" returned: 0 in 0.278s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Lock "cinder-quobyte-5ef34113-bcab-4b26-a602-72e3caf13c91" released by "delete_volume" :: held 0.839s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Acquiring lock "cinder-quobyte-8c76bb9e-c87a-414a-a38c-cf76d33f55bc" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Lock "cinder-quobyte-8c76bb9e-c87a-414a-a38c-cf76d33f55bc" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[067af356-32da-4d14-a1c7-ab5576e1bd4b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:23 devstack sudo[98759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc Sep 29 18:45:23 devstack sudo[98759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:23 devstack sudo[98759]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc" returned: 0 in 0.437s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:24 devstack sudo[98764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc Sep 29 18:45:24 devstack sudo[98764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:24 devstack sudo[98764]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8c76bb9e-c87a-414a-a38c-cf76d33f55bc" returned: 0 in 0.324s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Lock "cinder-quobyte-8c76bb9e-c87a-414a-a38c-cf76d33f55bc" released by "delete_volume" :: held 0.817s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:24 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Created reservations ['ca8a8cbc-ef8e-492a-9fe3-77881c05ed19'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:24 devstack cinder-volume[86523]: WARNING cinder.quota [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-847308803 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-847308803, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:45:24 devstack cinder-volume[86523]: WARNING cinder.quota [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-847308803 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-847308803, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:45:24 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Created reservations ['7d63fd68-c273-4957-9144-1dbd7887dfda', '401636d3-6e7e-4f03-8f51-8ad711083377', '474912d2-b2ad-435b-bc51-e9e53ad856d3', 'f37d7951-6877-4fed-a94d-5d1df21667e7'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:24 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Created reservations ['742735cc-7e3d-445c-a194-bd4787b542db', 'c004856e-067e-4071-8278-deb8b764a525', '0eb01007-a3d1-4bbc-b2f9-b0f448d02e15', '23f9deeb-a63f-4b36-980e-11ddb23bca8c'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:25 devstack sudo[98767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:45:25 devstack sudo[98767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:25 devstack sudo[98767]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.443s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:25 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:45:25 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2e34c756-3d61-4a50-bea9-5772dbb256ac tempest-GroupsTest-67699812 None] Delete group completed successfully. Sep 29 18:45:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:25 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Cloning volume ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c to volume 64d17f0b-c843-4442-b49a-cf6abbc58ead Sep 29 18:45:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Creating offline snapshot 9233bfb2-7752-4713-a237-6c636cdd03df of volume ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:45:25 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[070b96df-68fd-44b1-b9b1-8da180754e63]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:25 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c Sep 29 18:45:25 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:26 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c" returned: 0 in 0.510s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:26 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df 1G Sep 29 18:45:26 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:26 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df 1G" returned: 0 in 0.518s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:26 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df Sep 29 18:45:26 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:27 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df" returned: 0 in 0.352s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:27 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:45:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:27 devstack sudo[98787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df Sep 29 18:45:27 devstack sudo[98787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:27 devstack sudo[98787]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df" returned: 0 in 0.430s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:27 devstack sudo[98790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.info Sep 29 18:45:27 devstack sudo[98790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:27 devstack sudo[98790]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.info" returned: 0 in 0.323s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:27 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:45:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:27 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.info Sep 29 18:45:27 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:28 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.info" returned: 0 in 0.300s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Acquiring lock "cinder-quobyte-64d17f0b-c843-4442-b49a-cf6abbc58ead" by "_copy_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Lock "cinder-quobyte-64d17f0b-c843-4442-b49a-cf6abbc58ead" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] snapshot: 9233bfb2-7752-4713-a237-6c636cdd03df, volume: 64d17f0b-c843-4442-b49a-cf6abbc58ead, {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a365370f-25d9-42a2-a96d-629decdf7a94]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:28 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df Sep 29 18:45:28 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:28 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df" returned: 0 in 0.538s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[56c93774-2bf3-4a3a-84cb-c036273de2d7]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:29 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c Sep 29 18:45:29 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:29 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c" returned: 0 in 0.512s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:45:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Creating direct copy from snapshot {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:45:29 devstack cinder-volume[86523]: DEBUG cinder.utils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Path /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead not found in is_blk_device check {{(pid=86523) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:45:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:29 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead Sep 29 18:45:29 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-0e8a38bb-5a80-4c02-a506-8d81667acc0b req-107b83b0-164e-47a9-a8e8-82f862272c97 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:38 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead" returned: 0 in 8.755s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:38 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c, size 1024.00 MB, duration 8.76 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:45:38 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Converted 1024.00 MB image at 116.95 MB/s Sep 29 18:45:38 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead is being set with open permissions: ugo+rw: NotImplementedError Sep 29 18:45:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:38 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead Sep 29 18:45:38 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:38 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead" returned: 0 in 0.279s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Lock "cinder-quobyte-64d17f0b-c843-4442-b49a-cf6abbc58ead" released by "_copy_volume_from_snapshot" :: held 10.195s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Acquiring lock "cinder-quobyte-9233bfb2-7752-4713-a237-6c636cdd03df" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Lock "cinder-quobyte-9233bfb2-7752-4713-a237-6c636cdd03df" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Deleting offline snapshot 9233bfb2-7752-4713-a237-6c636cdd03df of volume ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:45:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] snapshot_file for this snap is: volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:45:38 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[70df7238-33df-4912-bf8e-cfaa4da6d208]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:38 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df Sep 29 18:45:38 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:39 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df" returned: 0 in 0.479s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:45:39 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82268dd-44cc-4540-bab0-c9a4a3372f91]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:39 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c Sep 29 18:45:39 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:39 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c" returned: 0 in 0.637s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:39 devstack sudo[98851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df Sep 29 18:45:39 devstack sudo[98851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:40 devstack sudo[98851]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df" returned: 0 in 0.440s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:40 devstack sudo[98857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df Sep 29 18:45:40 devstack sudo[98857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:40 devstack sudo[98857]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c.9233bfb2-7752-4713-a237-6c636cdd03df" returned: 0 in 0.375s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Lock "cinder-quobyte-9233bfb2-7752-4713-a237-6c636cdd03df" released by "_delete_snapshot" :: held 2.077s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.974s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-0e8a38bb-5a80-4c02-a506-8d81667acc0b req-107b83b0-164e-47a9-a8e8-82f862272c97 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.936s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-0e8a38bb-5a80-4c02-a506-8d81667acc0b req-107b83b0-164e-47a9-a8e8-82f862272c97 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-0e8a38bb-5a80-4c02-a506-8d81667acc0b req-107b83b0-164e-47a9-a8e8-82f862272c97 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4996de9d-9abf-427f-a4a1-e29179a962de', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:45:40 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-fae48d23-685e-44a5-9d8b-6d430d97e84c tempest-GroupsV314Test-1355868593 None] Create group from source-group-4418f02e-8d57-4fe7-8076-c33df4579812 completed successfully. Sep 29 18:45:40 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-0e8a38bb-5a80-4c02-a506-8d81667acc0b req-107b83b0-164e-47a9-a8e8-82f862272c97 tempest-TestServerVolumeAttachmentScenario-2127854079 None] attachment_update completed successfully. Sep 29 18:45:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Acquiring lock "cinder-quobyte-64d17f0b-c843-4442-b49a-cf6abbc58ead" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Lock "cinder-quobyte-64d17f0b-c843-4442-b49a-cf6abbc58ead" acquired by "delete_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:42 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7260371a-7940-4a2f-a7a7-356088680eee]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:42 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead Sep 29 18:45:42 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:43 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead" returned: 0 in 0.507s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:43 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead Sep 29 18:45:43 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:43 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-64d17f0b-c843-4442-b49a-cf6abbc58ead" returned: 0 in 0.335s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Lock "cinder-quobyte-64d17f0b-c843-4442-b49a-cf6abbc58ead" released by "delete_volume" :: held 0.921s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:43 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Created reservations ['d3041da9-63b5-4b5d-b284-8c48e318ed05'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:43 devstack cinder-volume[86523]: WARNING cinder.quota [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1778657610 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1778657610, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:45:43 devstack cinder-volume[86523]: WARNING cinder.quota [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1778657610 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1778657610, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:45:43 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Created reservations ['87fc01a7-947a-459e-8029-09f881c1a9a4', '622cce98-fae2-444f-8985-b4ad1c4650a7', '2b3fb6d8-829c-4ef5-9827-91e9a68539b9', 'c331f78d-bc16-4a56-86fa-e1e56e15e95c'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:43 devstack sudo[99289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:45:43 devstack sudo[99289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:44 devstack sudo[99289]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.314s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:44 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:45:44 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-499fabae-0bbe-4986-918c-f1665fa2bc26 tempest-GroupsV314Test-1355868593 None] Delete group completed successfully. Sep 29 18:45:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Acquiring lock "cinder-quobyte-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:45:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Lock "cinder-quobyte-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c" acquired by "delete_volume" :: waited 0.045s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:45:45 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1789987e-b4fa-4abb-87b8-51ea87aba3f9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:45 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c Sep 29 18:45:45 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:46 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c" returned: 0 in 0.529s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:46 devstack sudo[99298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c Sep 29 18:45:46 devstack sudo[99298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:46 devstack sudo[99298]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c" returned: 0 in 0.347s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:46 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Lock "cinder-quobyte-ef17de9c-4e90-47bb-8e9f-5fbe1b34ee7c" released by "delete_volume" :: held 1.012s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:45:46 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Created reservations ['24195db9-b20e-4cd4-88be-7179aeb69491'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:46 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Created reservations ['df443385-b3b1-4a1c-8dcb-71d766863048', 'd61bdd70-d441-4730-b57b-554c3e16fcd5', '077cb371-094f-43ee-aeed-2a1b8cdff553', '99d4c053-daa4-4a16-941f-917d6d43ba24'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:45:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:46 devstack sudo[99301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:45:46 devstack sudo[99301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:47 devstack sudo[99301]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.301s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:47 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:45:47 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-9fb8365d-9a35-4a35-b778-d9fc92c8ae8d tempest-GroupsV314Test-1355868593 None] Delete group completed successfully. Sep 29 18:45:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f649db31-a4d7-4de6-9531-2b39ec8c8f6d req-b43c3a12-59ad-4606-8686-89d32f4818bb tempest-TestServerVolumeAttachmentScenario-2127854079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f649db31-a4d7-4de6-9531-2b39ec8c8f6d req-b43c3a12-59ad-4606-8686-89d32f4818bb tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f649db31-a4d7-4de6-9531-2b39ec8c8f6d req-b43c3a12-59ad-4606-8686-89d32f4818bb tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f649db31-a4d7-4de6-9531-2b39ec8c8f6d req-b43c3a12-59ad-4606-8686-89d32f4818bb tempest-TestServerVolumeAttachmentScenario-2127854079 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '32ac37e5-154c-4e8d-b2e9-b44ea61901bd', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:45:48 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-f649db31-a4d7-4de6-9531-2b39ec8c8f6d req-b43c3a12-59ad-4606-8686-89d32f4818bb tempest-TestServerVolumeAttachmentScenario-2127854079 None] attachment_update completed successfully. Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Flow 'volume_create_manager' (88a9f282-26c8-48c4-83b2-fd7acb348011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0551fed0-8060-4778-aafa-2268c63351f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0551fed0-8060-4778-aafa-2268c63351f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1062395311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf8ad3c-7959-46d3-9ade-1e91c02a7284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384020f517a14c7cbefa7afbe6a37262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:45:49Z,use_quota=True,user_id='8a8de55032e64bda837cf6625d267e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4aedbb5-0199-4cfc-a8db-9ff7a8505409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4aedbb5-0199-4cfc-a8db-9ff7a8505409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82bc01f-2b94-49ca-9404-3504b75f63b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a82bc01f-2b94-49ca-9404-3504b75f63b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bf8ad3c-7959-46d3-9ade-1e91c02a7284', 'volume_name': 'volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9705ec02-f23c-4363-aa0c-518a573e2de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9705ec02-f23c-4363-aa0c-518a573e2de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9827fac0-3236-4985-8b2a-c3377cdf78a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:49 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Volume 7bf8ad3c-7959-46d3-9ade-1e91c02a7284: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284', 'volume_size': 1} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1062395311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bf8ad3c-7959-46d3-9ade-1e91c02a7284,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='384020f517a14c7cbefa7afbe6a37262',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:45:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:45:49Z,use_quota=True,user_id='8a8de55032e64bda837cf6625d267e5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Creating volume 7bf8ad3c-7959-46d3-9ade-1e91c02a7284 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:45:49 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:49 devstack sudo[99320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 1073741824 Sep 29 18:45:49 devstack sudo[99320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:49 devstack sudo[99320]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 1073741824" returned: 0 in 0.632s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:49 devstack sudo[99334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 Sep 29 18:45:49 devstack sudo[99334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:50 devstack sudo[99334]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284" returned: 0 in 0.350s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:45:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9827fac0-3236-4985-8b2a-c3377cdf78a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67b40c7-fa5d-4c2e-9ad6-f1d43fa6cac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:45:50 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Volume volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 (7bf8ad3c-7959-46d3-9ade-1e91c02a7284): created successfully Sep 29 18:45:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e67b40c7-fa5d-4c2e-9ad6-f1d43fa6cac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:45:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Flow 'volume_create_manager' (88a9f282-26c8-48c4-83b2-fd7acb348011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:45:50 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d430da69-ca39-44be-9716-f03c2f7da1ca tempest-TestImageHashVerification-1853589828 None] Created volume successfully. Sep 29 18:45:51 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-07b7164d-5a9b-4284-a138-1cc3a9f850ae req-9fd94976-a34d-4dca-ac06-3f14a61d6503 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Terminate volume connection completed successfully. Sep 29 18:45:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-07b7164d-5a9b-4284-a138-1cc3a9f850ae req-9fd94976-a34d-4dca-ac06-3f14a61d6503 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Deleting attachment 32ac37e5-154c-4e8d-b2e9-b44ea61901bd. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:45:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:52 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[08815e1e-a515-4611-86f8-673484b00390]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:52 devstack sudo[99343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 Sep 29 18:45:52 devstack sudo[99343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:52 devstack sudo[99343]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284" returned: 0 in 0.553s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:53 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cadfd1-2a63-4391-ab3e-e95e68988b1b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:45:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:53 devstack sudo[99349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 Sep 29 18:45:53 devstack sudo[99349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:53 devstack sudo[99349]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284" returned: 0 in 0.473s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 /opt/stack/data/cinder/conversion/7bf8ad3c-7959-46d3-9ade-1e91c02a7284.temp_image.01b6be02-9778-4cf1-9021-c0d46d4e4865_q8rgl6h.img {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:53 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 /opt/stack/data/cinder/conversion/7bf8ad3c-7959-46d3-9ade-1e91c02a7284.temp_image.01b6be02-9778-4cf1-9021-c0d46d4e4865_q8rgl6h.img Sep 29 18:45:53 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:53 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-d0807c56-87b8-41f1-b915-61d2cd4101fe req-805464af-5c8e-4859-bc4c-260a61f0fc1a tempest-TestServerVolumeAttachmentScenario-2127854079 None] Terminate volume connection completed successfully. Sep 29 18:45:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-d0807c56-87b8-41f1-b915-61d2cd4101fe req-805464af-5c8e-4859-bc4c-260a61f0fc1a tempest-TestServerVolumeAttachmentScenario-2127854079 None] Deleting attachment 4996de9d-9abf-427f-a4a1-e29179a962de. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:45:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:45:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:45:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:45:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:45:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:45:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:45:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:45:58 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:45:58 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:45:59 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Sep 29 18:45:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.508s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:45:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:45:59 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:45:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:45:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=135,cinder:INSERT=33,cinder:UPDATE=124,cinder:DELETE=5 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=133,cinder:UPDATE=157,cinder:DELETE=7,cinder:INSERT=29 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Flow 'volume_create_manager' (95c0c0c5-9628-43dd-b0fe-5bcbccd7b76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1062a0-3ec5-4ae3-83d6-18b2ef819323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e1062a0-3ec5-4ae3-83d6-18b2ef819323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1168567459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b569879-89e4-4136-afc2-a5681884a297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5e8b97d0e1145eda0505016caff64d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:01Z,use_quota=True,user_id='27b7b237405b482a91aaf1f26d089764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f843da52-619e-4118-8d08-13486cfca5ee),volume_type_id=f843da52-619e-4118-8d08-13486cfca5ee)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83910aa7-7f9f-4bdb-abac-0f6b2336ebf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83910aa7-7f9f-4bdb-abac-0f6b2336ebf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6986718b-b310-4a0d-8516-cb2814303739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6986718b-b310-4a0d-8516-cb2814303739) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b569879-89e4-4136-afc2-a5681884a297', 'volume_name': 'volume-8b569879-89e4-4136-afc2-a5681884a297', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d50752-4876-4204-9186-d329548ad764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3d50752-4876-4204-9186-d329548ad764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae9baae-446e-4167-8e3a-6d3826f9c101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:01 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Volume 8b569879-89e4-4136-afc2-a5681884a297: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b569879-89e4-4136-afc2-a5681884a297', 'volume_size': 1} Sep 29 18:46:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Acquiring lock "cinder-74d2ae15-72b9-457c-9eb4-b41f00dacc38-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "cinder-74d2ae15-72b9-457c-9eb4-b41f00dacc38-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Acquiring lock "cinder-quobyte-74d2ae15-72b9-457c-9eb4-b41f00dacc38" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "cinder-quobyte-74d2ae15-72b9-457c-9eb4-b41f00dacc38" acquired by "delete_volume" :: waited 0.040s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:02 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[240629b4-cece-4d07-b5a2-369c7e71ec7f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:02 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38 Sep 29 18:46:02 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:02 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 /opt/stack/data/cinder/conversion/7bf8ad3c-7959-46d3-9ade-1e91c02a7284.temp_image.01b6be02-9778-4cf1-9021-c0d46d4e4865_q8rgl6h.img" returned: 0 in 9.425s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:02 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed3306d-0ee0-4ae8-ac2d-79b9764e9c56]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:03 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38" returned: 0 in 0.473s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:03 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 Sep 29 18:46:03 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:03 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38 Sep 29 18:46:03 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:03 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-74d2ae15-72b9-457c-9eb4-b41f00dacc38" returned: 0 in 0.264s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "cinder-quobyte-74d2ae15-72b9-457c-9eb4-b41f00dacc38" released by "delete_volume" :: held 0.842s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Created reservations ['34d667e8-7547-4bd5-bb77-15a54270ff8f', 'a0d0fec8-1bdf-4953-91e2-58af84d2e9f3', '35bec55e-2acd-4671-8b2f-ff8370579cf9', '5a7f88f0-25ff-4cb8-9cc2-fb3b328345af'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:03 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:46:03 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:03 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284" returned: 0 in 0.639s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284, size 1024.00 MB, duration 9.43 sec, destination /opt/stack/data/cinder/conversion/7bf8ad3c-7959-46d3-9ade-1e91c02a7284.temp_image.01b6be02-9778-4cf1-9021-c0d46d4e4865_q8rgl6h.img {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:46:03 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] Converted 1024.00 MB image at 108.63 MB/s Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Acquiring lock "cinder-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] 01b6be02-9778-4cf1-9021-c0d46d4e4865 was raw, no need to convert to raw {{(pid=86523) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "cinder-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Acquiring lock "cinder-quobyte-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "cinder-quobyte-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e" acquired by "delete_volume" :: waited 0.033s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[971d42bc-8e3b-482c-9afe-07b74702af54]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:03 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.310s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:46:03 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Deleted volume successfully. Sep 29 18:46:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5beef65-6952-4e67-abc2-3ef76ff72e46 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "cinder-74d2ae15-72b9-457c-9eb4-b41f00dacc38-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:03 devstack sudo[99486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e Sep 29 18:46:03 devstack sudo[99486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:04 devstack sudo[99486]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e" returned: 0 in 0.453s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:04 devstack sudo[99492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e Sep 29 18:46:04 devstack sudo[99492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:04 devstack sudo[99492]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e" returned: 0 in 0.280s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "cinder-quobyte-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e" released by "delete_volume" :: held 0.792s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Created reservations ['879d581d-1e85-47de-8fea-309396d1ea0f', '38baa20a-bd04-4bf4-8ad8-9d8275b5984d', 'd516af20-f093-496a-a915-1fd75d7e531d', 'd36e720c-88f9-4912-a3c1-1452ef569ba3'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:04 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:46:04 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:04 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.293s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:46:04 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Deleted volume successfully. Sep 29 18:46:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-19799718-3ff5-4a61-bfab-d74841507203 tempest-TestServerVolumeAttachmentScenario-2127854079 None] Lock "cinder-f15c8dc7-1023-4e73-88fb-efb6cf6d8f9e-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:09 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:46:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Flow 'volume_create_manager' (1ef6e912-7482-4ecd-b5e9-e1b6d17bf99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d641eaa7-3e26-4c4c-8974-75d4f640b00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d641eaa7-3e26-4c4c-8974-75d4f640b00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-927765614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9760c8-1b1c-40f8-af9f-fc004995dd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16b465a9578493eb42fcb3c9b48c980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:09Z,use_quota=True,user_id='adb74b5f497844abb95c4afef3619f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c793bcb5-7848-4a17-b243-439bc7c920b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c793bcb5-7848-4a17-b243-439bc7c920b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe818f7-28e7-4ca3-912f-0ed20f029194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfe818f7-28e7-4ca3-912f-0ed20f029194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9760c8-1b1c-40f8-af9f-fc004995dd98', 'volume_name': 'volume-db9760c8-1b1c-40f8-af9f-fc004995dd98', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615a80fc-9247-434d-aff3-6b5adf3db192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615a80fc-9247-434d-aff3-6b5adf3db192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc8d257-afc5-4ee6-ac11-9666205de1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:09 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Volume db9760c8-1b1c-40f8-af9f-fc004995dd98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9760c8-1b1c-40f8-af9f-fc004995dd98', 'volume_size': 1} Sep 29 18:46:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:18 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:46:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Flow 'volume_create_manager' (a55f83e0-5aeb-4682-9401-0eb761b3b62d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4755a1ec-47fd-41da-ab7c-62729a42ca94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4755a1ec-47fd-41da-ab7c-62729a42ca94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797971187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1444f9-901b-47d2-ab7a-4b871909aa89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8c9f87578b4e0b850daa499872a5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:19Z,use_quota=True,user_id='33d27b66e89a41b4b0bc736c1ff25361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c770440d-e443-4020-ab8e-bbac4ec61c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c770440d-e443-4020-ab8e-bbac4ec61c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579b0b4a-f1f7-4885-b876-cb78332ff553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (579b0b4a-f1f7-4885-b876-cb78332ff553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d1444f9-901b-47d2-ab7a-4b871909aa89', 'volume_name': 'volume-0d1444f9-901b-47d2-ab7a-4b871909aa89', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fc0196-6be4-43b2-b0ef-a5560415fc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37fc0196-6be4-43b2-b0ef-a5560415fc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d4109a-52c6-444a-94ed-a6960f272980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:18 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Volume 0d1444f9-901b-47d2-ab7a-4b871909aa89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d1444f9-901b-47d2-ab7a-4b871909aa89', 'volume_size': 1} Sep 29 18:46:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Flow 'volume_create_manager' (c36da61c-6f15-4bbc-888d-5a9cfd822292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dfcad4-4e8b-4135-85de-dd7502357df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36dfcad4-4e8b-4135-85de-dd7502357df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-18554929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7735bee-6150-4d54-ad34-56b630b1e5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8c9f87578b4e0b850daa499872a5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:19Z,use_quota=True,user_id='33d27b66e89a41b4b0bc736c1ff25361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb3a52d-b060-4e68-a4c4-eb902cd4168e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb3a52d-b060-4e68-a4c4-eb902cd4168e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f48a69-8228-40b0-a724-b2ea10ed7529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99f48a69-8228-40b0-a724-b2ea10ed7529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7735bee-6150-4d54-ad34-56b630b1e5dd', 'volume_name': 'volume-d7735bee-6150-4d54-ad34-56b630b1e5dd', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d048806-45a5-4501-8b9d-1e3a5cd5fac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d048806-45a5-4501-8b9d-1e3a5cd5fac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2f21f4-a4c4-434b-81c0-8ed5f1a5411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Volume d7735bee-6150-4d54-ad34-56b630b1e5dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7735bee-6150-4d54-ad34-56b630b1e5dd', 'volume_size': 1} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Flow 'volume_create_manager' (bc6f84b0-c10d-4aea-92fe-fa098cd19f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffc6e72-422c-4f1a-af86-cc4e8e8a1f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bffc6e72-422c-4f1a-af86-cc4e8e8a1f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-456835611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6e72b9-f8e8-45b6-8c48-39c74d2a3769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8c9f87578b4e0b850daa499872a5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:19Z,use_quota=True,user_id='33d27b66e89a41b4b0bc736c1ff25361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd05439c-5b66-4db5-879c-0fea42971bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd05439c-5b66-4db5-879c-0fea42971bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06d332a-71b5-484f-8ad7-5f804f3f8c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d06d332a-71b5-484f-8ad7-5f804f3f8c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe6e72b9-f8e8-45b6-8c48-39c74d2a3769', 'volume_name': 'volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74907442-f212-4cdc-b525-26d3a665bd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74907442-f212-4cdc-b525-26d3a665bd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3e1fe5-ed4e-43a2-85b5-857110cc8424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Volume fe6e72b9-f8e8-45b6-8c48-39c74d2a3769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769', 'volume_size': 1} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Flow 'volume_create_manager' (3164ca64-b426-46c6-9245-6531e1a64fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c55004-4f54-4483-b770-ed92755de455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6c55004-4f54-4483-b770-ed92755de455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2030269370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60d9b5a-c904-4457-acc0-9adacdc0baa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8c9f87578b4e0b850daa499872a5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:20Z,use_quota=True,user_id='33d27b66e89a41b4b0bc736c1ff25361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c279eae8-084c-4ee2-ac18-11425c96ad91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c279eae8-084c-4ee2-ac18-11425c96ad91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef03e672-267a-485d-98d6-e55af0f30800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef03e672-267a-485d-98d6-e55af0f30800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a60d9b5a-c904-4457-acc0-9adacdc0baa4', 'volume_name': 'volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13666a25-fd4d-4fd2-839e-5a18804f144a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13666a25-fd4d-4fd2-839e-5a18804f144a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e834deb-a3dc-409c-be1c-629073958456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:20 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Volume a60d9b5a-c904-4457-acc0-9adacdc0baa4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4', 'volume_size': 1} Sep 29 18:46:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:20 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:46:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Flow 'volume_create_manager' (8fbb965f-65e2-46ef-8adf-74ddebaf7bf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986fac3a-8033-4d4d-89a1-5a25ecdc917c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (986fac3a-8033-4d4d-89a1-5a25ecdc917c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-346276427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df09db72-fb65-4bc0-991b-92eb332c58c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8c9f87578b4e0b850daa499872a5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:20Z,use_quota=True,user_id='33d27b66e89a41b4b0bc736c1ff25361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72a6483-f49b-41ff-87b4-52d43a46c304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a72a6483-f49b-41ff-87b4-52d43a46c304) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3155ff19-2c3a-44bf-81de-9fa668ed6d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3155ff19-2c3a-44bf-81de-9fa668ed6d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df09db72-fb65-4bc0-991b-92eb332c58c6', 'volume_name': 'volume-df09db72-fb65-4bc0-991b-92eb332c58c6', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61cc0fb9-bbfe-4d41-8247-65e79e2da5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61cc0fb9-bbfe-4d41-8247-65e79e2da5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e27971-f70e-437f-8c32-1e480aa7254a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:20 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Volume df09db72-fb65-4bc0-991b-92eb332c58c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df09db72-fb65-4bc0-991b-92eb332c58c6', 'volume_size': 1} Sep 29 18:46:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.387s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] Uploaded volume to glance image-id: 01b6be02-9778-4cf1-9021-c0d46d4e4865. {{(pid=86523) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1782}} Sep 29 18:46:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.299s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1168567459',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b569879-89e4-4136-afc2-a5681884a297,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5e8b97d0e1145eda0505016caff64d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:01Z,use_quota=True,user_id='27b7b237405b482a91aaf1f26d089764',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f843da52-619e-4118-8d08-13486cfca5ee),volume_type_id=f843da52-619e-4118-8d08-13486cfca5ee)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:46:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Creating volume 8b569879-89e4-4136-afc2-a5681884a297 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:46:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:46:24 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:46:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8b569879-89e4-4136-afc2-a5681884a297 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:24 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8b569879-89e4-4136-afc2-a5681884a297 1073741824 Sep 29 18:46:24 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:24 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-75dc8006-d664-4188-88da-4553f62840a9 tempest-TestImageHashVerification-1853589828 None] Copy volume to image completed successfully. Sep 29 18:46:25 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8b569879-89e4-4136-afc2-a5681884a297 1073741824" returned: 0 in 0.473s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8b569879-89e4-4136-afc2-a5681884a297 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:25 devstack sudo[99511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8b569879-89e4-4136-afc2-a5681884a297 Sep 29 18:46:25 devstack sudo[99511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:25 devstack sudo[99511]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8b569879-89e4-4136-afc2-a5681884a297" returned: 0 in 0.260s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.476s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-927765614',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9760c8-1b1c-40f8-af9f-fc004995dd98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d16b465a9578493eb42fcb3c9b48c980',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:09Z,use_quota=True,user_id='adb74b5f497844abb95c4afef3619f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Creating volume db9760c8-1b1c-40f8-af9f-fc004995dd98 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:46:25 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ae9baae-446e-4167-8e3a-6d3826f9c101) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b569879-89e4-4136-afc2-a5681884a297', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:25 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 1073741824 Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567a37de-be88-419c-9082-c9c85b1d4fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:25 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Acquiring lock "cinder-7bf8ad3c-7959-46d3-9ade-1e91c02a7284-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:25 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Volume volume-8b569879-89e4-4136-afc2-a5681884a297 (8b569879-89e4-4136-afc2-a5681884a297): created successfully Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (567a37de-be88-419c-9082-c9c85b1d4fd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Flow 'volume_create_manager' (95c0c0c5-9628-43dd-b0fe-5bcbccd7b76a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Lock "cinder-7bf8ad3c-7959-46d3-9ade-1e91c02a7284-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:25 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-38b2c72b-7d58-4075-bff4-0480552c07f8 tempest-VolumeTypesAccessTest-197616659 None] Created volume successfully. Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Acquiring lock "cinder-quobyte-7bf8ad3c-7959-46d3-9ade-1e91c02a7284" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Lock "cinder-quobyte-7bf8ad3c-7959-46d3-9ade-1e91c02a7284" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb343ff-97f9-4da9-9f6e-c6a1b20b5f57]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:25 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 Sep 29 18:46:25 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Acquiring lock "cinder-8b569879-89e4-4136-afc2-a5681884a297-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Lock "cinder-8b569879-89e4-4136-afc2-a5681884a297-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Acquiring lock "cinder-quobyte-8b569879-89e4-4136-afc2-a5681884a297" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Lock "cinder-quobyte-8b569879-89e4-4136-afc2-a5681884a297" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[091a27fa-6c8c-4f47-8e37-804f141ab411]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8b569879-89e4-4136-afc2-a5681884a297 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:26 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 1073741824" returned: 0 in 0.544s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:26 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8b569879-89e4-4136-afc2-a5681884a297 Sep 29 18:46:26 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:26 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 Sep 29 18:46:26 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:26 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284" returned: 0 in 0.464s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:26 devstack sudo[99530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284 Sep 29 18:46:26 devstack sudo[99530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:26 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8b569879-89e4-4136-afc2-a5681884a297" returned: 0 in 0.385s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8b569879-89e4-4136-afc2-a5681884a297 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:26 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98" returned: 0 in 0.271s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.710s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1797971187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d1444f9-901b-47d2-ab7a-4b871909aa89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8c9f87578b4e0b850daa499872a5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:19Z,use_quota=True,user_id='33d27b66e89a41b4b0bc736c1ff25361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Creating volume 0d1444f9-901b-47d2-ab7a-4b871909aa89 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:46:26 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:46:26 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8b569879-89e4-4136-afc2-a5681884a297 Sep 29 18:46:26 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0d1444f9-901b-47d2-ab7a-4b871909aa89 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:26 devstack sudo[99539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0d1444f9-901b-47d2-ab7a-4b871909aa89 1073741824 Sep 29 18:46:26 devstack sudo[99539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc8d257-afc5-4ee6-ac11-9666205de1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9760c8-1b1c-40f8-af9f-fc004995dd98', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:26 devstack sudo[99530]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f65be7-142e-42ce-b6ce-fbe93e08cc82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7bf8ad3c-7959-46d3-9ade-1e91c02a7284" returned: 0 in 0.312s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:26 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Volume volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 (db9760c8-1b1c-40f8-af9f-fc004995dd98): created successfully Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69f65be7-142e-42ce-b6ce-fbe93e08cc82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Flow 'volume_create_manager' (1ef6e912-7482-4ecd-b5e9-e1b6d17bf99b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Lock "cinder-quobyte-7bf8ad3c-7959-46d3-9ade-1e91c02a7284" released by "delete_volume" :: held 0.845s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:26 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-68c356cf-bd84-4e98-8dc8-5cc999cc6775 tempest-SnapshotMetadataTestJSON-2003546655 None] Created volume successfully. Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Created reservations ['2a3fec7e-75ab-483a-b805-e421238afd17', '5141ff3a-038c-4100-873d-e380773f78d2', '7f5230ca-5e9e-4a70-b027-bdfb35004a8a', '3d00171e-c898-49a2-bc9c-ce91e7b52ba3'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:26 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8b569879-89e4-4136-afc2-a5681884a297" returned: 0 in 0.295s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:26 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:46:26 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Lock "cinder-quobyte-8b569879-89e4-4136-afc2-a5681884a297" released by "delete_volume" :: held 0.751s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:26 devstack cinder-volume[86523]: WARNING cinder.quota [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-307576688 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-307576688, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:46:26 devstack cinder-volume[86523]: WARNING cinder.quota [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-307576688 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-307576688, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Created reservations ['33782f5b-a98a-4bb0-8e47-66e24327ff43', 'a095bbeb-d103-4872-93c6-6d87dc5f2c6d', '6fe640bb-08ce-4fd4-9d41-5af02b527dc1', '80483f02-f1fd-4b53-8b00-4ad747c3210f'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:26 devstack sudo[99548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:46:26 devstack sudo[99548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:26 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.300s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:46:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Deleted volume successfully. Sep 29 18:46:27 devstack sudo[99539]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0d1444f9-901b-47d2-ab7a-4b871909aa89 1073741824" returned: 0 in 0.585s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-40d79433-0fad-4960-aed8-c7193376167a tempest-TestImageHashVerification-1853589828 None] Lock "cinder-7bf8ad3c-7959-46d3-9ade-1e91c02a7284-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0d1444f9-901b-47d2-ab7a-4b871909aa89 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:27 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0d1444f9-901b-47d2-ab7a-4b871909aa89 Sep 29 18:46:27 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:27 devstack sudo[99548]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.384s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:46:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Deleted volume successfully. Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7c681cbc-4ee8-49b5-a1f6-c3726981db6b tempest-VolumeTypesAccessTest-197616659 None] Lock "cinder-8b569879-89e4-4136-afc2-a5681884a297-delete_volume" released by "delete_volume" :: held 1.429s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:27 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0d1444f9-901b-47d2-ab7a-4b871909aa89" returned: 0 in 0.456s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.446s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-18554929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7735bee-6150-4d54-ad34-56b630b1e5dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8c9f87578b4e0b850daa499872a5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:19Z,use_quota=True,user_id='33d27b66e89a41b4b0bc736c1ff25361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Creating volume d7735bee-6150-4d54-ad34-56b630b1e5dd {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:46:27 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d7735bee-6150-4d54-ad34-56b630b1e5dd 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:27 devstack sudo[99555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d7735bee-6150-4d54-ad34-56b630b1e5dd 1073741824 Sep 29 18:46:27 devstack sudo[99555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d4109a-52c6-444a-94ed-a6960f272980) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d1444f9-901b-47d2-ab7a-4b871909aa89', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e890e5b2-cfbf-430c-9600-c5e36b867072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:27 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Volume volume-0d1444f9-901b-47d2-ab7a-4b871909aa89 (0d1444f9-901b-47d2-ab7a-4b871909aa89): created successfully Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e890e5b2-cfbf-430c-9600-c5e36b867072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Flow 'volume_create_manager' (a55f83e0-5aeb-4682-9401-0eb761b3b62d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-49d4d3ce-9139-4d48-b738-66dbb2a2ef7a tempest-CreateVolumesFromImageTest-1285251257 None] Created volume successfully. Sep 29 18:46:28 devstack sudo[99555]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d7735bee-6150-4d54-ad34-56b630b1e5dd 1073741824" returned: 0 in 0.549s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d7735bee-6150-4d54-ad34-56b630b1e5dd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:28 devstack sudo[99560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d7735bee-6150-4d54-ad34-56b630b1e5dd Sep 29 18:46:28 devstack sudo[99560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:28 devstack sudo[99560]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d7735bee-6150-4d54-ad34-56b630b1e5dd" returned: 0 in 0.271s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.823s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-456835611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe6e72b9-f8e8-45b6-8c48-39c74d2a3769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8c9f87578b4e0b850daa499872a5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:19Z,use_quota=True,user_id='33d27b66e89a41b4b0bc736c1ff25361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Creating volume fe6e72b9-f8e8-45b6-8c48-39c74d2a3769 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:46:28 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec2f21f4-a4c4-434b-81c0-8ed5f1a5411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7735bee-6150-4d54-ad34-56b630b1e5dd', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ef4f47-0cd5-4e2b-a127-372e4a91c19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:28 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769 1073741824 Sep 29 18:46:28 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:28 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Volume volume-d7735bee-6150-4d54-ad34-56b630b1e5dd (d7735bee-6150-4d54-ad34-56b630b1e5dd): created successfully Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08ef4f47-0cd5-4e2b-a127-372e4a91c19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Flow 'volume_create_manager' (c36da61c-6f15-4bbc-888d-5a9cfd822292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:28 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-5711d6af-8f6c-4260-b606-25f3023c9c98 tempest-CreateVolumesFromImageTest-1285251257 None] Created volume successfully. Sep 29 18:46:29 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769 1073741824" returned: 0 in 0.656s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:29 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769 Sep 29 18:46:29 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:29 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769" returned: 0 in 0.299s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.457s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2030269370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a60d9b5a-c904-4457-acc0-9adacdc0baa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8c9f87578b4e0b850daa499872a5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:20Z,use_quota=True,user_id='33d27b66e89a41b4b0bc736c1ff25361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Creating volume a60d9b5a-c904-4457-acc0-9adacdc0baa4 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:46:29 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e3e1fe5-ed4e-43a2-85b5-857110cc8424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:29 devstack sudo[99573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4 1073741824 Sep 29 18:46:29 devstack sudo[99573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3bc711-f933-4a26-a639-7ac47f746ccf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:29 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Volume volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769 (fe6e72b9-f8e8-45b6-8c48-39c74d2a3769): created successfully Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3bc711-f933-4a26-a639-7ac47f746ccf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Flow 'volume_create_manager' (bc6f84b0-c10d-4aea-92fe-fa098cd19f9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:29 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-962ee4a6-692f-40ce-b6b5-eebc01b1dd61 tempest-CreateVolumesFromImageTest-1285251257 None] Created volume successfully. Sep 29 18:46:30 devstack sudo[99573]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4 1073741824" returned: 0 in 0.570s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:30 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4 Sep 29 18:46:30 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:30 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4" returned: 0 in 0.248s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.980s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-346276427',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df09db72-fb65-4bc0-991b-92eb332c58c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e8c9f87578b4e0b850daa499872a5aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:20Z,use_quota=True,user_id='33d27b66e89a41b4b0bc736c1ff25361',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Creating volume df09db72-fb65-4bc0-991b-92eb332c58c6 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:46:30 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-df09db72-fb65-4bc0-991b-92eb332c58c6 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e834deb-a3dc-409c-be1c-629073958456) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394b0124-9c95-4a7e-9f86-7ebff04418a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:30 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-df09db72-fb65-4bc0-991b-92eb332c58c6 1073741824 Sep 29 18:46:30 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:30 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Volume volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4 (a60d9b5a-c904-4457-acc0-9adacdc0baa4): created successfully Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (394b0124-9c95-4a7e-9f86-7ebff04418a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Flow 'volume_create_manager' (3164ca64-b426-46c6-9245-6531e1a64fe2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-0ed7ac0d-90b6-4231-87a9-fa144e9cb528 tempest-CreateVolumesFromImageTest-1285251257 None] Created volume successfully. Sep 29 18:46:30 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-df09db72-fb65-4bc0-991b-92eb332c58c6 1073741824" returned: 0 in 0.479s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-df09db72-fb65-4bc0-991b-92eb332c58c6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:30 devstack sudo[99589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-df09db72-fb65-4bc0-991b-92eb332c58c6 Sep 29 18:46:30 devstack sudo[99589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:31 devstack sudo[99589]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-df09db72-fb65-4bc0-991b-92eb332c58c6" returned: 0 in 0.322s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:46:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.793s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3e27971-f70e-437f-8c32-1e480aa7254a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df09db72-fb65-4bc0-991b-92eb332c58c6', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33293e2c-a993-47ca-b4c9-eb077e91e0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] Creating offline snapshot 6137794a-1fef-4db1-b261-2d960ec96fcc of volume db9760c8-1b1c-40f8-af9f-fc004995dd98 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:46:31 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Volume volume-df09db72-fb65-4bc0-991b-92eb332c58c6 (df09db72-fb65-4bc0-991b-92eb332c58c6): created successfully Sep 29 18:46:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33293e2c-a993-47ca-b4c9-eb077e91e0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Flow 'volume_create_manager' (8fbb965f-65e2-46ef-8adf-74ddebaf7bf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:31 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0091bf5-e253-4f1e-b899-9d00d1456115]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:31 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d858f211-d84f-4c55-851b-0e44a4bc8217 tempest-CreateVolumesFromImageTest-1285251257 None] Created volume successfully. Sep 29 18:46:31 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 Sep 29 18:46:31 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:31 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98" returned: 0 in 0.501s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:31 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc 1G Sep 29 18:46:31 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:32 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "cinder-df09db72-fb65-4bc0-991b-92eb332c58c6-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:32 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc 1G" returned: 0 in 0.606s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:32 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-df09db72-fb65-4bc0-991b-92eb332c58c6-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:32 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc Sep 29 18:46:32 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:32 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "cinder-quobyte-df09db72-fb65-4bc0-991b-92eb332c58c6" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:32 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-quobyte-df09db72-fb65-4bc0-991b-92eb332c58c6" acquired by "delete_volume" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:32 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e40b86a0-0e37-43da-9c21-f911761bfb14]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-df09db72-fb65-4bc0-991b-92eb332c58c6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:32 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-df09db72-fb65-4bc0-991b-92eb332c58c6 Sep 29 18:46:32 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:32 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc" returned: 0 in 0.377s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:32 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc is being set with open permissions: ugo+rw Sep 29 18:46:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:32 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc Sep 29 18:46:32 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:33 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-df09db72-fb65-4bc0-991b-92eb332c58c6" returned: 0 in 0.481s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-df09db72-fb65-4bc0-991b-92eb332c58c6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:33 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc" returned: 0 in 0.344s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:33 devstack sudo[99620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-df09db72-fb65-4bc0-991b-92eb332c58c6 Sep 29 18:46:33 devstack sudo[99620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:33 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.info Sep 29 18:46:33 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:33 devstack sudo[99620]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-df09db72-fb65-4bc0-991b-92eb332c58c6" returned: 0 in 0.317s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-quobyte-df09db72-fb65-4bc0-991b-92eb332c58c6" released by "delete_volume" :: held 0.892s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:33 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.info" returned: 0 in 0.330s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:33 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.info is being set with open permissions: ugo+rw Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Created reservations ['d881ae9a-79fe-4ddc-a4d3-2138b2c37be0', '675b4b9c-bae4-49a6-bf09-f2049bc1f28d', '12c27b1b-103a-4f57-8c97-cfe6e462c8a9', '490ea88b-2cda-4234-baa0-bd2882724b38'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:46:33 devstack sudo[99626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.info Sep 29 18:46:33 devstack sudo[99626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:33 devstack sudo[99628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:46:33 devstack sudo[99628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:33 devstack sudo[99626]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.info" returned: 0 in 0.398s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.737s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:34 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2517e837-82b0-4e29-aa2f-05721555ddb8 tempest-SnapshotMetadataTestJSON-2003546655 None] Create snapshot completed successfully Sep 29 18:46:34 devstack sudo[99628]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.337s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:34 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:46:34 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Deleted volume successfully. Sep 29 18:46:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da10f6d6-d245-4ceb-b20d-9a010dc8df39 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-df09db72-fb65-4bc0-991b-92eb332c58c6-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "cinder-a60d9b5a-c904-4457-acc0-9adacdc0baa4-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-a60d9b5a-c904-4457-acc0-9adacdc0baa4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "cinder-quobyte-a60d9b5a-c904-4457-acc0-9adacdc0baa4" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-quobyte-a60d9b5a-c904-4457-acc0-9adacdc0baa4" acquired by "delete_volume" :: waited 0.032s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:34 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f6e265-9d94-4ddf-a350-8898722cc501]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:35 devstack sudo[99635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4 Sep 29 18:46:35 devstack sudo[99635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:35 devstack sudo[99635]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4" returned: 0 in 0.519s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:35 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4 Sep 29 18:46:35 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:35 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a60d9b5a-c904-4457-acc0-9adacdc0baa4" returned: 0 in 0.352s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-quobyte-a60d9b5a-c904-4457-acc0-9adacdc0baa4" released by "delete_volume" :: held 0.934s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:35 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Created reservations ['cd2a3141-0e84-494c-a9ac-3790a4cfd5e5', '6effebac-adbf-4b1c-8193-2eb9de51040a', '68d2d1f4-8d37-4aa9-9a84-58d89dd13166', 'd195aba4-5965-49b9-8937-d5c69a42d055'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Acquiring lock "cinder-6137794a-1fef-4db1-b261-2d960ec96fcc-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "cinder-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:36 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:46:36 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "cinder-6137794a-1fef-4db1-b261-2d960ec96fcc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Acquiring lock "cinder-quobyte-db9760c8-1b1c-40f8-af9f-fc004995dd98" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "cinder-quobyte-db9760c8-1b1c-40f8-af9f-fc004995dd98" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Acquiring lock "cinder-quobyte-6137794a-1fef-4db1-b261-2d960ec96fcc" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "cinder-quobyte-6137794a-1fef-4db1-b261-2d960ec96fcc" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Deleting offline snapshot 6137794a-1fef-4db1-b261-2d960ec96fcc of volume db9760c8-1b1c-40f8-af9f-fc004995dd98 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] snapshot_file for this snap is: volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[786166f5-5e15-44e0-b1c1-0c4c3a65a4cf]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "cinder-quobyte-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-quobyte-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[089c1ea7-a677-4089-ab68-bfa86e72c7d2]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:36 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc Sep 29 18:46:36 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:36 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.367s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:46:36 devstack sudo[99646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769 Sep 29 18:46:36 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Deleted volume successfully. Sep 29 18:46:36 devstack sudo[99646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-424dbd92-213f-4b78-9ffd-92d2e274e21b tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-a60d9b5a-c904-4457-acc0-9adacdc0baa4-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:36 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc" returned: 0 in 0.658s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db9760c8-1b1c-40f8-af9f-fc004995dd98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:46:36 devstack sudo[99646]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769" returned: 0 in 0.619s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[545919bf-fe3d-495b-851f-a876e56730c3]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:36 devstack sudo[99656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769 Sep 29 18:46:36 devstack sudo[99656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:37 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 Sep 29 18:46:37 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:37 devstack sudo[99656]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769" returned: 0 in 0.369s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-quobyte-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769" released by "delete_volume" :: held 1.053s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Created reservations ['01d35ebf-4834-4bf6-b61c-adc5500d88b5', '81cdd7bb-9d9d-4819-bcde-1f12fda8cae4', 'c226f7f7-583b-43a0-88be-6f941a586d54', 'a920aab5-db20-448a-a1b5-4e6291852c55'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:46:37 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98" returned: 0 in 0.468s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:37 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc Sep 29 18:46:37 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:37 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:46:37 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:37 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc" returned: 0 in 0.445s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:37 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.370s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:46:37 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc Sep 29 18:46:37 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:37 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Deleted volume successfully. Sep 29 18:46:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97c8791e-2159-4f13-bce5-dbc5cc44afe6 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-fe6e72b9-f8e8-45b6-8c48-39c74d2a3769-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:38 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98.6137794a-1fef-4db1-b261-2d960ec96fcc" returned: 0 in 0.316s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "cinder-quobyte-6137794a-1fef-4db1-b261-2d960ec96fcc" released by "_delete_snapshot" :: held 2.075s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "cinder-quobyte-db9760c8-1b1c-40f8-af9f-fc004995dd98" released by "delete_snapshot" :: held 2.122s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "cinder-d7735bee-6150-4d54-ad34-56b630b1e5dd-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:38 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Created reservations ['79846938-9958-4df2-8f37-be66270dd6e6', '196e56ab-72f1-4cd2-a3df-3229ca80a722', '44069115-f31f-419f-bd51-a8fd4a151c62', '8cb23d2e-48d4-4491-bbd3-aba161914ceb'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:46:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-d7735bee-6150-4d54-ad34-56b630b1e5dd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "cinder-quobyte-d7735bee-6150-4d54-ad34-56b630b1e5dd" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-quobyte-d7735bee-6150-4d54-ad34-56b630b1e5dd" acquired by "delete_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:38 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Delete snapshot completed successfully. Sep 29 18:46:38 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b4d2f59-95fb-498f-87c0-71a39d8e2d97]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d7735bee-6150-4d54-ad34-56b630b1e5dd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f4b0be99-05f8-4c4d-88c4-0044a65b4811 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "cinder-6137794a-1fef-4db1-b261-2d960ec96fcc-delete_snapshot" released by "delete_snapshot" :: held 2.422s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:38 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d7735bee-6150-4d54-ad34-56b630b1e5dd Sep 29 18:46:38 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:38 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d7735bee-6150-4d54-ad34-56b630b1e5dd" returned: 0 in 0.431s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d7735bee-6150-4d54-ad34-56b630b1e5dd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:38 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d7735bee-6150-4d54-ad34-56b630b1e5dd Sep 29 18:46:38 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:39 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d7735bee-6150-4d54-ad34-56b630b1e5dd" returned: 0 in 0.286s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-quobyte-d7735bee-6150-4d54-ad34-56b630b1e5dd" released by "delete_volume" :: held 0.780s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Created reservations ['1804b362-1fc5-4117-93f9-63af8154f80f', '05ca2d5a-41d2-4e87-a72f-2584f9db733f', '34016a39-799f-4080-9aaf-a520eb62436c', '796cd89e-cf98-44d4-b418-b384e6c5229a'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Acquiring lock "cinder-db9760c8-1b1c-40f8-af9f-fc004995dd98-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "cinder-db9760c8-1b1c-40f8-af9f-fc004995dd98-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:39 devstack sudo[99688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "cinder-0d1444f9-901b-47d2-ab7a-4b871909aa89-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:39 devstack sudo[99688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Acquiring lock "cinder-quobyte-db9760c8-1b1c-40f8-af9f-fc004995dd98" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-0d1444f9-901b-47d2-ab7a-4b871909aa89-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "cinder-quobyte-db9760c8-1b1c-40f8-af9f-fc004995dd98" acquired by "delete_volume" :: waited 0.037s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "cinder-quobyte-0d1444f9-901b-47d2-ab7a-4b871909aa89" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[30582653-50e9-4da5-8ef0-8d9136a54a43]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-quobyte-0d1444f9-901b-47d2-ab7a-4b871909aa89" acquired by "delete_volume" :: waited 0.033s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a51ceb49-927f-4968-8b35-de6a254b1ba7]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0d1444f9-901b-47d2-ab7a-4b871909aa89 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:39 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 Sep 29 18:46:39 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:40 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0d1444f9-901b-47d2-ab7a-4b871909aa89 Sep 29 18:46:40 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:40 devstack sudo[99688]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.639s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:40 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:46:40 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Deleted volume successfully. Sep 29 18:46:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab5bd367-4579-4cb2-867b-d68a51224189 tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-d7735bee-6150-4d54-ad34-56b630b1e5dd-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:40 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98" returned: 0 in 0.511s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:40 devstack sudo[99699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98 Sep 29 18:46:40 devstack sudo[99699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:40 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0d1444f9-901b-47d2-ab7a-4b871909aa89" returned: 0 in 0.650s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0d1444f9-901b-47d2-ab7a-4b871909aa89 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:40 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0d1444f9-901b-47d2-ab7a-4b871909aa89 Sep 29 18:46:40 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:40 devstack sudo[99699]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-db9760c8-1b1c-40f8-af9f-fc004995dd98" returned: 0 in 0.499s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "cinder-quobyte-db9760c8-1b1c-40f8-af9f-fc004995dd98" released by "delete_volume" :: held 1.186s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:40 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0d1444f9-901b-47d2-ab7a-4b871909aa89" returned: 0 in 0.385s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-quobyte-0d1444f9-901b-47d2-ab7a-4b871909aa89" released by "delete_volume" :: held 1.106s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:40 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Created reservations ['99e4a342-f261-4cdb-8cfa-b385b07daf3c', 'fa51ab2f-c83f-42e8-9450-9fd1d7b90fd5', 'c00bd392-357e-4c07-a8dd-ce678e319ea1', '061939c4-d65e-495e-a716-2e2b6091b291'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Created reservations ['cfdcb6b0-c1c1-4d04-8672-408de831837c', '0c39aae6-5929-4356-b6ed-297844de12af', 'ddbc265c-66e5-45f7-9542-b8f445e31fb1', '82e4f337-3195-4dfa-b14c-045dc6970462'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:41 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:46:41 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:41 devstack sudo[99710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:46:41 devstack sudo[99710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:41 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.342s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:46:41 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Deleted volume successfully. Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6a669076-5dc3-49e6-b5cd-97802aedb251 tempest-SnapshotMetadataTestJSON-2003546655 None] Lock "cinder-db9760c8-1b1c-40f8-af9f-fc004995dd98-delete_volume" released by "delete_volume" :: held 1.963s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:41 devstack sudo[99710]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.329s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:46:41 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Deleted volume successfully. Sep 29 18:46:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a90640a5-18a1-43a4-b992-9a627be496ba tempest-CreateVolumesFromImageTest-1285251257 None] Lock "cinder-0d1444f9-901b-47d2-ab7a-4b871909aa89-delete_volume" released by "delete_volume" :: held 1.934s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Flow 'volume_create_manager' (7c3a95a8-8b7d-4b4e-af38-5e0a54258c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41681f22-f249-46d5-afd1-18032928acb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41681f22-f249-46d5-afd1-18032928acb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1051146113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbadf73b-8ff3-4760-a2ff-ba10ff43a2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822dd7425f6f4c32a38ee5c649c3ff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:43Z,use_quota=True,user_id='3d8f679dcb4a4fd582c208c359c152e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864d920b-3876-45ee-8f29-f05d408df498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864d920b-3876-45ee-8f29-f05d408df498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388c1a59-c4c9-4af3-8f12-9757e17f6272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (388c1a59-c4c9-4af3-8f12-9757e17f6272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbadf73b-8ff3-4760-a2ff-ba10ff43a2df', 'volume_name': 'volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbbd6f47-b4bd-4fbf-8bcf-26f401a0c2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbbd6f47-b4bd-4fbf-8bcf-26f401a0c2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72ee836-c884-403b-9517-fe44f744d531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:43 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Volume dbadf73b-8ff3-4760-a2ff-ba10ff43a2df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df', 'volume_size': 1} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1051146113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbadf73b-8ff3-4760-a2ff-ba10ff43a2df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822dd7425f6f4c32a38ee5c649c3ff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:43Z,use_quota=True,user_id='3d8f679dcb4a4fd582c208c359c152e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Creating volume dbadf73b-8ff3-4760-a2ff-ba10ff43a2df {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:46:43 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:46:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:43 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df 1073741824 Sep 29 18:46:43 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:44 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df 1073741824" returned: 0 in 0.528s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:44 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df Sep 29 18:46:44 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:44 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df" returned: 0 in 0.309s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:46:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b72ee836-c884-403b-9517-fe44f744d531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7557d44-90ac-4603-92de-8f3dd4eca39b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:44 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Volume volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df (dbadf73b-8ff3-4760-a2ff-ba10ff43a2df): created successfully Sep 29 18:46:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7557d44-90ac-4603-92de-8f3dd4eca39b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Flow 'volume_create_manager' (7c3a95a8-8b7d-4b4e-af38-5e0a54258c57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:44 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3abad2f7-cff9-4f0f-b302-04bbea250d9b tempest-VolumeDependencyTests-1763155869 None] Created volume successfully. Sep 29 18:46:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] Creating offline snapshot 64544fc6-7383-47b3-aa13-e1b5781b3d3a of volume dbadf73b-8ff3-4760-a2ff-ba10ff43a2df {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:46:45 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d531cb-bdf2-44cb-8a97-f74c76820a2d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:46 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df Sep 29 18:46:46 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:46 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df" returned: 0 in 0.393s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:46 devstack sudo[99729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a 1G Sep 29 18:46:46 devstack sudo[99729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:46 devstack sudo[99729]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a 1G" returned: 0 in 0.613s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:46 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a Sep 29 18:46:46 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Flow 'volume_create_manager' (014cd801-c71b-431c-9832-c7538d54049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae2e14f-1618-436a-9a26-48dbb3f7c4e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae2e14f-1618-436a-9a26-48dbb3f7c4e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2060907070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe9afb5-e8eb-458a-9bad-7d9cb97a4393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fea660e9e14458e839f089a83752a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:47Z,use_quota=True,user_id='688bf5b48b544db3b451d226a5369ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c558e382-696d-46c3-adf2-baad4af58f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c558e382-696d-46c3-adf2-baad4af58f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:47 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d755d9d7-8b9f-4598-a560-578ad41b4850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d755d9d7-8b9f-4598-a560-578ad41b4850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe9afb5-e8eb-458a-9bad-7d9cb97a4393', 'volume_name': 'volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9df5886-1ab8-4dc3-81dc-b362543e9900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9df5886-1ab8-4dc3-81dc-b362543e9900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95b9309-af80-4465-92ad-ab5ea36e4123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:47 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume 9fe9afb5-e8eb-458a-9bad-7d9cb97a4393: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393', 'volume_size': 1} Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a" returned: 0 in 0.413s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:47 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a is being set with open permissions: ugo+rw Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:47 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a Sep 29 18:46:47 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:47 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a" returned: 0 in 0.298s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:47 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.info Sep 29 18:46:47 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:48 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.info" returned: 0 in 0.340s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:48 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.info is being set with open permissions: ugo+rw Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:48 devstack sudo[99747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.info Sep 29 18:46:48 devstack sudo[99747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (570b17e4-4a3c-4c5d-ab96-005fdd94f4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74122dd-d7b1-4a4c-8063-f7ae9ad7698d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:48 devstack sudo[99747]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.info" returned: 0 in 0.292s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74122dd-d7b1-4a4c-8063-f7ae9ad7698d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1589008772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='24e22c1568584b3394f82865e86769b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:48Z,use_quota=True,user_id='e7a46f6068154174a6d0db44e20e5bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e083c0-026b-4dbf-9442-dacd2ee65da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e083c0-026b-4dbf-9442-dacd2ee65da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7448c65f-49f7-4b0e-84df-3a05b4e2c4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7448c65f-49f7-4b0e-84df-3a05b4e2c4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3', 'volume_name': 'volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645655e5-82c9-4401-a18e-e13aa0924fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (645655e5-82c9-4401-a18e-e13aa0924fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ba88fe-4d4d-43f8-9b0a-8b7570878466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:48 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Volume 36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3', 'volume_size': 1} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.051s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2060907070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe9afb5-e8eb-458a-9bad-7d9cb97a4393,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fea660e9e14458e839f089a83752a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:47Z,use_quota=True,user_id='688bf5b48b544db3b451d226a5369ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Creating volume 9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:46:48 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:48 devstack sudo[99750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 1073741824 Sep 29 18:46:48 devstack sudo[99750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:48 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-28f96210-7e70-492c-a801-2b83c0902316 tempest-VolumeDependencyTests-1763155869 None] Create snapshot completed successfully Sep 29 18:46:48 devstack sudo[99750]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 1073741824" returned: 0 in 0.431s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:48 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 Sep 29 18:46:48 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:49 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393" returned: 0 in 0.268s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1589008772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='24e22c1568584b3394f82865e86769b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:48Z,use_quota=True,user_id='e7a46f6068154174a6d0db44e20e5bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Creating volume 36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:46:49 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a95b9309-af80-4465-92ad-ab5ea36e4123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:49 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3 1073741824 Sep 29 18:46:49 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02104e0e-9e1c-44ff-b01c-52bb9490c6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:49 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 (9fe9afb5-e8eb-458a-9bad-7d9cb97a4393): created successfully Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02104e0e-9e1c-44ff-b01c-52bb9490c6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Flow 'volume_create_manager' (014cd801-c71b-431c-9832-c7538d54049e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:49 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8bf2e533-03d2-4ff6-8976-a90632c3c8f1 tempest-CreateVolumesFromSnapshotTest-62300794 None] Created volume successfully. Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Flow 'volume_create_manager' (92ffacff-8320-4694-a730-d779a9b90f16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41918ae8-cbfe-48f3-8637-7820dc6e79a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:49 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3 1073741824" returned: 0 in 0.649s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41918ae8-cbfe-48f3-8637-7820dc6e79a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-697389753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f488c0f6-1d78-493a-8a90-0f024dc8626e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='822dd7425f6f4c32a38ee5c649c3ff19',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=64544fc6-7383-47b3-aa13-e1b5781b3d3a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:50Z,use_quota=True,user_id='3d8f679dcb4a4fd582c208c359c152e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8383603-0c75-410e-a920-5f19f65a03b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8383603-0c75-410e-a920-5f19f65a03b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297805b2-bac8-4c28-807d-8608aa80c55f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (297805b2-bac8-4c28-807d-8608aa80c55f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f488c0f6-1d78-493a-8a90-0f024dc8626e', 'volume_name': 'volume-f488c0f6-1d78-493a-8a90-0f024dc8626e', 'volume_size': 1, 'snapshot_id': '64544fc6-7383-47b3-aa13-e1b5781b3d3a'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98384013-0b9c-4ac1-8d26-7b3a4ceba77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98384013-0b9c-4ac1-8d26-7b3a4ceba77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5abac9e-c164-422c-9315-6e0b1a446354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:49 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Volume f488c0f6-1d78-493a-8a90-0f024dc8626e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f488c0f6-1d78-493a-8a90-0f024dc8626e', 'volume_size': 1, 'snapshot_id': '64544fc6-7383-47b3-aa13-e1b5781b3d3a'} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:49 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3 Sep 29 18:46:49 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:50 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3" returned: 0 in 0.242s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.263s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "cinder-quobyte-64544fc6-7383-47b3-aa13-e1b5781b3d3a-f488c0f6-1d78-493a-8a90-0f024dc8626e" by "_create_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2ba88fe-4d4d-43f8-9b0a-8b7570878466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abee81b4-230a-4cf7-9629-7915e9566a02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-quobyte-64544fc6-7383-47b3-aa13-e1b5781b3d3a-f488c0f6-1d78-493a-8a90-0f024dc8626e" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Creating volume f488c0f6-1d78-493a-8a90-0f024dc8626e from snapshot 64544fc6-7383-47b3-aa13-e1b5781b3d3a {{(pid=86523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "cinder-quobyte-f488c0f6-1d78-493a-8a90-0f024dc8626e" by "_copy_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:46:50 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Volume volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3 (36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3): created successfully Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abee81b4-230a-4cf7-9629-7915e9566a02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (570b17e4-4a3c-4c5d-ab96-005fdd94f4ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-quobyte-f488c0f6-1d78-493a-8a90-0f024dc8626e" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] snapshot: 64544fc6-7383-47b3-aa13-e1b5781b3d3a, volume: f488c0f6-1d78-493a-8a90-0f024dc8626e, {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:46:50 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-99032f71-374f-457b-a8d8-4fead30b0efa tempest-VolumesGetTest-1497843584 None] Created volume successfully. Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bedcd7-48c1-4803-bb40-1afc5c8a1226]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:50 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a Sep 29 18:46:50 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:50 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a" returned: 0 in 0.565s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c96749-20e4-490d-8d7a-6bb52d1064fa]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:51 devstack sudo[99775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df Sep 29 18:46:51 devstack sudo[99775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:51 devstack sudo[99775]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df" returned: 0 in 0.417s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Creating direct copy from snapshot {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.utils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Path /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e not found in is_blk_device check {{(pid=86523) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:51 devstack sudo[99781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e Sep 29 18:46:51 devstack sudo[99781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (aa6342ed-b6ca-400b-b9cf-afd730b5ab8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb082a20-aa6b-44fe-9b9c-91a056b3ee81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb082a20-aa6b-44fe-9b9c-91a056b3ee81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1275719935',display_name='tempest-VolumesGetTest-Volume-844884932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786530bf-6d22-46fb-9920-60997cbd6045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e22c1568584b3394f82865e86769b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:51Z,use_quota=True,user_id='e7a46f6068154174a6d0db44e20e5bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27739e01-a357-4107-9f60-84f2287d0dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27739e01-a357-4107-9f60-84f2287d0dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4f06ae-e926-441c-9ae6-bd015057ecf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df4f06ae-e926-441c-9ae6-bd015057ecf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '786530bf-6d22-46fb-9920-60997cbd6045', 'volume_name': 'volume-786530bf-6d22-46fb-9920-60997cbd6045', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f28a8d6-db10-44d2-87b6-f4e9d7d82eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f28a8d6-db10-44d2-87b6-f4e9d7d82eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5bdd4f-af13-4deb-9102-348f90585aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:51 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Volume 786530bf-6d22-46fb-9920-60997cbd6045: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-786530bf-6d22-46fb-9920-60997cbd6045', 'volume_size': 1} Sep 29 18:46:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:46:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:46:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:46:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:46:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:58 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:46:58 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:59 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.598s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:46:59 devstack sudo[99781]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e" returned: 0 in 7.982s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df, size 1024.00 MB, duration 7.98 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:46:59 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Converted 1024.00 MB image at 128.27 MB/s Sep 29 18:46:59 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e is being set with open permissions: ugo+rw Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:59 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e Sep 29 18:46:59 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:46:59 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e" returned: 0 in 0.256s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-quobyte-f488c0f6-1d78-493a-8a90-0f024dc8626e" released by "_copy_volume_from_snapshot" :: held 9.343s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-quobyte-64544fc6-7383-47b3-aa13-e1b5781b3d3a-f488c0f6-1d78-493a-8a90-0f024dc8626e" released by "_create_volume_from_snapshot" :: held 9.424s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.456s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.693s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] Creating offline snapshot 267cba80-f0d3-40d8-bdff-5537a0608567 of volume 9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5abac9e-c164-422c-9315-6e0b1a446354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f488c0f6-1d78-493a-8a90-0f024dc8626e', 'volume_size': 1, 'snapshot_id': '64544fc6-7383-47b3-aa13-e1b5781b3d3a'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5b3ac8-21cd-467b-853e-f582a5ff7d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c3d402-d340-4fab-a222-bb7168da48c9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:46:59 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Volume volume-f488c0f6-1d78-493a-8a90-0f024dc8626e (f488c0f6-1d78-493a-8a90-0f024dc8626e): created successfully Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b5b3ac8-21cd-467b-853e-f582a5ff7d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:46:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Flow 'volume_create_manager' (92ffacff-8320-4694-a730-d779a9b90f16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:46:59 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a65a4751-cf72-4fbc-8f78-92deb5562133 tempest-VolumeDependencyTests-1763155869 None] Created volume successfully. Sep 29 18:46:59 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 Sep 29 18:46:59 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "cinder-64544fc6-7383-47b3-aa13-e1b5781b3d3a-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-64544fc6-7383-47b3-aa13-e1b5781b3d3a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "cinder-quobyte-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-quobyte-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "cinder-quobyte-64544fc6-7383-47b3-aa13-e1b5781b3d3a" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-quobyte-64544fc6-7383-47b3-aa13-e1b5781b3d3a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Deleting offline snapshot 64544fc6-7383-47b3-aa13-e1b5781b3d3a of volume dbadf73b-8ff3-4760-a2ff-ba10ff43a2df {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] snapshot_file for this snap is: volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84afb30-914b-47a7-8fa7-0c23b481d9f9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:00 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393" returned: 0 in 0.508s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:00 devstack sudo[99848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 1G Sep 29 18:47:00 devstack sudo[99848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:00 devstack sudo[99847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a Sep 29 18:47:00 devstack sudo[99847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:00 devstack sudo[99847]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a" returned: 0 in 0.417s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cc8fd5-a4c1-4c23-bb53-99fed0525492]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:00 devstack sudo[99848]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 1G" returned: 0 in 0.476s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:00 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df Sep 29 18:47:00 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:00 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 Sep 29 18:47:00 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:00 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567" returned: 0 in 0.321s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:00 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 is being set with open permissions: ugo+rw Sep 29 18:47:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:01 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 Sep 29 18:47:01 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:01 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df" returned: 0 in 0.599s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:01 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a Sep 29 18:47:01 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:01 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567" returned: 0 in 0.275s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:01 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.info Sep 29 18:47:01 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:01 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a" returned: 0 in 0.387s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:01 devstack sudo[99880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a Sep 29 18:47:01 devstack sudo[99880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:01 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.info" returned: 0 in 0.301s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:01 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.info is being set with open permissions: ugo+rw Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:01 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.info Sep 29 18:47:01 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:01 devstack sudo[99880]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df.64544fc6-7383-47b3-aa13-e1b5781b3d3a" returned: 0 in 0.274s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=91,cinder:INSERT=32,cinder:UPDATE=129,cinder:DELETE=9 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=118,cinder:SELECT=94,cinder:INSERT=26,cinder:DELETE=14 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:47:01 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.info" returned: 0 in 0.259s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.281s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-quobyte-64544fc6-7383-47b3-aa13-e1b5781b3d3a" released by "_delete_snapshot" :: held 1.834s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.387s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:46:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1275719935',display_name='tempest-VolumesGetTest-Volume-844884932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=786530bf-6d22-46fb-9920-60997cbd6045,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e22c1568584b3394f82865e86769b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:46:51Z,use_quota=True,user_id='e7a46f6068154174a6d0db44e20e5bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Creating volume 786530bf-6d22-46fb-9920-60997cbd6045 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:01 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-786530bf-6d22-46fb-9920-60997cbd6045 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:01 devstack sudo[99886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-786530bf-6d22-46fb-9920-60997cbd6045 1073741824 Sep 29 18:47:01 devstack sudo[99886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:01 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-quobyte-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df" released by "delete_snapshot" :: held 1.894s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:01 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-986c814c-8b57-4f28-9cf8-8e85e7c71d52 tempest-CreateVolumesFromSnapshotTest-62300794 None] Create snapshot completed successfully Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Created reservations ['8e03063e-64e9-486f-a934-fd6ca1453d1d', '641bba01-aa39-45db-b38f-abe52a690279', '3bd9ac5e-027e-4315-ab34-ba5a656184a9', '7221cfdc-c873-4f76-9815-ccf94b14fd19'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:02 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Delete snapshot completed successfully. Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-abc2a0ea-d55e-46d2-9f72-c07b99096ec9 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-64544fc6-7383-47b3-aa13-e1b5781b3d3a-delete_snapshot" released by "delete_snapshot" :: held 2.160s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "cinder-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "cinder-quobyte-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-quobyte-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df" acquired by "delete_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[067fb5be-4dea-48e5-802b-29d06d2f114c]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:02 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df Sep 29 18:47:02 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:02 devstack sudo[99886]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-786530bf-6d22-46fb-9920-60997cbd6045 1073741824" returned: 0 in 0.623s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-786530bf-6d22-46fb-9920-60997cbd6045 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:02 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-786530bf-6d22-46fb-9920-60997cbd6045 Sep 29 18:47:02 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:02 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df" returned: 0 in 0.519s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:02 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-786530bf-6d22-46fb-9920-60997cbd6045" returned: 0 in 0.332s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:02 devstack sudo[99902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df Sep 29 18:47:02 devstack sudo[99902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5bdd4f-af13-4deb-9102-348f90585aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-786530bf-6d22-46fb-9920-60997cbd6045', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8430e8b0-8bfe-4068-8135-f40a54e5d0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:03 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Volume volume-786530bf-6d22-46fb-9920-60997cbd6045 (786530bf-6d22-46fb-9920-60997cbd6045): created successfully Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8430e8b0-8bfe-4068-8135-f40a54e5d0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (aa6342ed-b6ca-400b-b9cf-afd730b5ab8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:03 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e78c3af2-077e-49d5-bb46-049323925e58 tempest-VolumesGetTest-1497843584 None] Created volume successfully. Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Flow 'volume_create_manager' (0c66a29d-76b7-4af3-ba03-3ee29261f7de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a554db-2377-494b-8669-bbfddbf180e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:03 devstack sudo[99902]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a554db-2377-494b-8669-bbfddbf180e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1283797649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fea660e9e14458e839f089a83752a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:03Z,use_quota=True,user_id='688bf5b48b544db3b451d226a5369ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27cec39-e4f3-41ee-afd7-fdfd5d33a895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27cec39-e4f3-41ee-afd7-fdfd5d33a895) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b55ef64-3fde-41db-b798-63f8b51e5fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b55ef64-3fde-41db-b798-63f8b51e5fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4', 'volume_name': 'volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f48ece-bda0-4d99-a1f4-903230182909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f48ece-bda0-4d99-a1f4-903230182909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784921e6-5001-4a46-84dc-e2fed851b7f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:03 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4', 'volume_size': 1} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1283797649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fea660e9e14458e839f089a83752a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:03Z,use_quota=True,user_id='688bf5b48b544db3b451d226a5369ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Creating volume dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:03 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df" returned: 0 in 0.454s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-quobyte-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df" released by "delete_volume" :: held 1.076s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:03 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4 1073741824 Sep 29 18:47:03 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Created reservations ['806db9b6-b4ed-416e-8760-bd1b1ac074db', 'ad79d94d-b87f-4f03-a152-ae77cff46163', '534f0bd1-9884-489b-92d1-c214690f2106', '9188e9c6-c736-40c3-beeb-2bcb89c42571'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:03 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:03 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Flow 'volume_create_manager' (445abb5e-e80c-4d12-b640-e2304272687b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d5b3fb-cd15-458a-8485-9beaf12d1327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-786530bf-6d22-46fb-9920-60997cbd6045-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3d5b3fb-cd15-458a-8485-9beaf12d1327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1494738081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74ff29f-41d4-4c6d-9037-7e7750b959d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fea660e9e14458e839f089a83752a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:04Z,use_quota=True,user_id='688bf5b48b544db3b451d226a5369ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239e38b5-6c1e-40b3-9a56-7786db1908bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (239e38b5-6c1e-40b3-9a56-7786db1908bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be2651b-d01e-4ad7-99e8-2edfc6d8d58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5be2651b-d01e-4ad7-99e8-2edfc6d8d58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f74ff29f-41d4-4c6d-9037-7e7750b959d9', 'volume_name': 'volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed7d5a5-e3c2-41a4-ae74-a7810fc194c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fed7d5a5-e3c2-41a4-ae74-a7810fc194c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d34e70-bdf3-4e58-8e8c-a127f64161b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:04 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume f74ff29f-41d4-4c6d-9037-7e7750b959d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9', 'volume_size': 1} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Lock "cinder-786530bf-6d22-46fb-9920-60997cbd6045-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:04 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.543s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:04 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Deleted volume successfully. Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-quobyte-786530bf-6d22-46fb-9920-60997cbd6045" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-bb0efe25-ea34-4d71-9452-c42f71d895d4 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-dbadf73b-8ff3-4760-a2ff-ba10ff43a2df-delete_volume" released by "delete_volume" :: held 2.045s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:04 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4 1073741824" returned: 0 in 0.975s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-786530bf-6d22-46fb-9920-60997cbd6045" acquired by "delete_volume" :: waited 0.048s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadc6e78-e2f9-41f6-b2c1-47c1a4d6ef3f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-786530bf-6d22-46fb-9920-60997cbd6045 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:04 devstack sudo[99916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4 Sep 29 18:47:04 devstack sudo[99916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:04 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-786530bf-6d22-46fb-9920-60997cbd6045 Sep 29 18:47:04 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Flow 'volume_create_manager' (7db3ddfb-2258-45cc-9a48-ba3096ae745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bd8108-c284-4dce-8e7f-35f0fc9f11bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51bd8108-c284-4dce-8e7f-35f0fc9f11bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-234746712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1580633-65f9-4fdf-89d2-00bf68f1d0d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fea660e9e14458e839f089a83752a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:04Z,use_quota=True,user_id='688bf5b48b544db3b451d226a5369ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34aa08f-44ad-4b4f-9e55-26390bbe4f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f34aa08f-44ad-4b4f-9e55-26390bbe4f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b954fc6-a6ec-4241-9a79-f3b63bf44312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b954fc6-a6ec-4241-9a79-f3b63bf44312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1580633-65f9-4fdf-89d2-00bf68f1d0d0', 'volume_name': 'volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5befd070-ade8-4761-8672-2827b1996705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5befd070-ade8-4761-8672-2827b1996705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6e0ed5-070c-4353-b857-010b941e5048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:04 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume d1580633-65f9-4fdf-89d2-00bf68f1d0d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0', 'volume_size': 1} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "cinder-f488c0f6-1d78-493a-8a90-0f024dc8626e-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-f488c0f6-1d78-493a-8a90-0f024dc8626e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "cinder-quobyte-f488c0f6-1d78-493a-8a90-0f024dc8626e" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-quobyte-f488c0f6-1d78-493a-8a90-0f024dc8626e" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[df09c231-ce14-4c3f-91ec-d91083bb1c3a]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:05 devstack sudo[99916]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4" returned: 0 in 0.631s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] <== create_volume: return (1740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.887s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1494738081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f74ff29f-41d4-4c6d-9037-7e7750b959d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fea660e9e14458e839f089a83752a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:04Z,use_quota=True,user_id='688bf5b48b544db3b451d226a5369ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Creating volume f74ff29f-41d4-4c6d-9037-7e7750b959d9 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:05 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:05 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-786530bf-6d22-46fb-9920-60997cbd6045" returned: 0 in 0.754s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-786530bf-6d22-46fb-9920-60997cbd6045 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:05 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9 1073741824 Sep 29 18:47:05 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (784921e6-5001-4a46-84dc-e2fed851b7f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee77fdb-c649-4e11-be8b-b53496409292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:05 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e Sep 29 18:47:05 devstack sudo[99937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-786530bf-6d22-46fb-9920-60997cbd6045 Sep 29 18:47:05 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:05 devstack sudo[99937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:05 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4 (dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4): created successfully Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee77fdb-c649-4e11-be8b-b53496409292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Flow 'volume_create_manager' (0c66a29d-76b7-4af3-ba03-3ee29261f7de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:05 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3875be50-4d52-4250-8e11-337ec35ec5b0 tempest-CreateVolumesFromSnapshotTest-62300794 None] Created volume successfully. Sep 29 18:47:05 devstack sudo[99937]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-786530bf-6d22-46fb-9920-60997cbd6045" returned: 0 in 0.417s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-786530bf-6d22-46fb-9920-60997cbd6045" released by "delete_volume" :: held 1.277s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Flow 'volume_create_manager' (e8fd9222-e74e-424d-93f7-116bea325031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03b51e4-e1b3-46b9-bf9c-f95715bf7bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b03b51e4-e1b3-46b9-bf9c-f95715bf7bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-534865601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f0915b-a633-4e45-b9c2-232514867175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fea660e9e14458e839f089a83752a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:06Z,use_quota=True,user_id='688bf5b48b544db3b451d226a5369ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125e486d-2554-40a7-8ba0-cbad283b8063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (125e486d-2554-40a7-8ba0-cbad283b8063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a45bcf-73a3-48f5-86fd-6aaa0de92b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a45bcf-73a3-48f5-86fd-6aaa0de92b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f0915b-a633-4e45-b9c2-232514867175', 'volume_name': 'volume-b8f0915b-a633-4e45-b9c2-232514867175', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f164be47-fb5f-4a27-a837-576bd790b59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f164be47-fb5f-4a27-a837-576bd790b59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457a87ec-5f22-4898-a94f-fd034b0752d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:05 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume b8f0915b-a633-4e45-b9c2-232514867175: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f0915b-a633-4e45-b9c2-232514867175', 'volume_size': 1} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:05 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e" returned: 0 in 0.818s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:05 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e Sep 29 18:47:05 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:05 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Created reservations ['d23a3480-ecdd-47a6-a32a-d1db672fe42d', '44513e9e-bc45-4d5c-873b-ac4d364a1def', 'a9297bea-514a-423c-8a08-c89deefedc19', 'f492ad9f-1ff6-460b-8b7c-286912ad8ad4'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:06 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9 1073741824" returned: 0 in 1.162s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:06 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:06 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:06 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f488c0f6-1d78-493a-8a90-0f024dc8626e" returned: 0 in 0.582s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:06 devstack sudo[99961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9 Sep 29 18:47:06 devstack sudo[99961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-quobyte-f488c0f6-1d78-493a-8a90-0f024dc8626e" released by "delete_volume" :: held 1.495s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Created reservations ['6456cacb-410f-4ea9-aca7-59dd8f61196c', '0e099e68-abe3-4735-b825-686370ea3bd8', 'b387e077-dfbe-481b-ba5d-c7aef2819af0', '1b6c3aee-56c0-4b08-b5cc-81feaa67d9e0'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:06 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.498s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Flow 'volume_create_manager' (074ca11c-2602-4cf2-af53-d38b6c4332b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2d38b8-3133-4415-bb6c-855b0acf2609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:06 devstack sudo[99961]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:06 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Deleted volume successfully. Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Lock "cinder-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3-delete_volume" acquired by "delete_volume" :: waited 0.095s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2d38b8-3133-4415-bb6c-855b0acf2609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212624061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94908b4-0096-4bdf-995f-0a693bbf80c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fea660e9e14458e839f089a83752a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:07Z,use_quota=True,user_id='688bf5b48b544db3b451d226a5369ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a704499-7536-4f6d-bc32-3c159754dfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a704499-7536-4f6d-bc32-3c159754dfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b580d740-f8e9-40ce-9ac2-13bac6b977e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b580d740-f8e9-40ce-9ac2-13bac6b977e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94908b4-0096-4bdf-995f-0a693bbf80c0', 'volume_name': 'volume-a94908b4-0096-4bdf-995f-0a693bbf80c0', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc727615-cf5f-49bc-80bd-fb8c575200a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc727615-cf5f-49bc-80bd-fb8c575200a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0199ddc6-306a-4839-aacc-2f30e2d204f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:06 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume a94908b4-0096-4bdf-995f-0a693bbf80c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94908b4-0096-4bdf-995f-0a693bbf80c0', 'volume_size': 1} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9" returned: 0 in 0.501s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.088s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-234746712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1580633-65f9-4fdf-89d2-00bf68f1d0d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fea660e9e14458e839f089a83752a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:04Z,use_quota=True,user_id='688bf5b48b544db3b451d226a5369ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Creating volume d1580633-65f9-4fdf-89d2-00bf68f1d0d0 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:06 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:06 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0 1073741824 Sep 29 18:47:06 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4d34e70-bdf3-4e58-8e8c-a127f64161b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8041ee95-3c65-461c-805a-704c0ee4f949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4ad55a46-8511-46d0-aeef-7d3dcbf29482 tempest-VolumesGetTest-1497843584 None] Lock "cinder-786530bf-6d22-46fb-9920-60997cbd6045-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:07 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9 (f74ff29f-41d4-4c6d-9037-7e7750b959d9): created successfully Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8041ee95-3c65-461c-805a-704c0ee4f949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Flow 'volume_create_manager' (445abb5e-e80c-4d12-b640-e2304272687b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:07 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-70a81160-24a2-4531-9b46-7da21222c021 tempest-CreateVolumesFromSnapshotTest-62300794 None] Created volume successfully. Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-quobyte-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:07 devstack sudo[99967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:07 devstack sudo[99967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a9dd1b-bb18-4fd4-878e-73fd73e9ca37]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:07 devstack sudo[99969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3 Sep 29 18:47:07 devstack sudo[99969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:07 devstack sudo[99967]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.426s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:07 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Deleted volume successfully. Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0933d0ce-38d9-43f0-98e0-9d8567e644a7 tempest-VolumeDependencyTests-1763155869 None] Lock "cinder-f488c0f6-1d78-493a-8a90-0f024dc8626e-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:07 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0 1073741824" returned: 0 in 0.767s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:07 devstack sudo[99969]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3" returned: 0 in 0.680s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:07 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0 Sep 29 18:47:07 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:07 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3 Sep 29 18:47:07 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:08 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0" returned: 0 in 0.320s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.215s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.290s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-534865601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f0915b-a633-4e45-b9c2-232514867175,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fea660e9e14458e839f089a83752a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:06Z,use_quota=True,user_id='688bf5b48b544db3b451d226a5369ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Creating volume b8f0915b-a633-4e45-b9c2-232514867175 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:08 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b8f0915b-a633-4e45-b9c2-232514867175 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb6e0ed5-070c-4353-b857-010b941e5048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4f85d7-a1dd-41ca-96c5-5209266afb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:08 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b8f0915b-a633-4e45-b9c2-232514867175 1073741824 Sep 29 18:47:08 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:08 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0 (d1580633-65f9-4fdf-89d2-00bf68f1d0d0): created successfully Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac4f85d7-a1dd-41ca-96c5-5209266afb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Flow 'volume_create_manager' (7db3ddfb-2258-45cc-9a48-ba3096ae745c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:08 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-79f0454b-81c6-456b-8fc0-4d398523fea4 tempest-CreateVolumesFromSnapshotTest-62300794 None] Created volume successfully. Sep 29 18:47:08 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3" returned: 0 in 0.518s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3" released by "delete_volume" :: held 1.277s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Created reservations ['bf021951-0f8a-4fe4-9a01-cceae32c3803', '6a2ab4e4-5422-47a7-bccd-117083133120', 'ad376dfa-af0f-486c-9d54-4f91aee6446d', 'd8722988-e3f8-426c-a26a-2753da7523c9'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:08 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:08 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:08 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b8f0915b-a633-4e45-b9c2-232514867175 1073741824" returned: 0 in 0.827s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b8f0915b-a633-4e45-b9c2-232514867175 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:09 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:09 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b8f0915b-a633-4e45-b9c2-232514867175 Sep 29 18:47:09 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.555s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:09 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Deleted volume successfully. Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-420e53e5-f835-42f8-840f-c53bbbcdceed tempest-VolumesGetTest-1497843584 None] Lock "cinder-36d1f0b9-ac6e-4c39-9dfd-dca2f29436b3-delete_volume" released by "delete_volume" :: held 2.430s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:09 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b8f0915b-a633-4e45-b9c2-232514867175" returned: 0 in 0.540s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.729s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1212624061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94908b4-0096-4bdf-995f-0a693bbf80c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fea660e9e14458e839f089a83752a95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:07Z,use_quota=True,user_id='688bf5b48b544db3b451d226a5369ff4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Creating volume a94908b4-0096-4bdf-995f-0a693bbf80c0 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:09 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a94908b4-0096-4bdf-995f-0a693bbf80c0 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:09 devstack sudo[100037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a94908b4-0096-4bdf-995f-0a693bbf80c0 1073741824 Sep 29 18:47:09 devstack sudo[100037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (457a87ec-5f22-4898-a94f-fd034b0752d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f0915b-a633-4e45-b9c2-232514867175', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f33392-8941-42d7-b7f8-cdb6baecae08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:09 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume volume-b8f0915b-a633-4e45-b9c2-232514867175 (b8f0915b-a633-4e45-b9c2-232514867175): created successfully Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f33392-8941-42d7-b7f8-cdb6baecae08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Flow 'volume_create_manager' (e8fd9222-e74e-424d-93f7-116bea325031) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:09 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-829e61d5-30db-4096-8952-6a23608592db tempest-CreateVolumesFromSnapshotTest-62300794 None] Created volume successfully. Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (d503fd1e-245e-41f7-af8b-d231ee79675f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa43fbdd-d788-4229-b62b-6335d59d893f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa43fbdd-d788-4229-b62b-6335d59d893f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1901539342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909f9628-bba7-43f9-a4f9-86df2b2df18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e22c1568584b3394f82865e86769b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:10Z,use_quota=True,user_id='e7a46f6068154174a6d0db44e20e5bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a46414a-f727-449f-82d9-3c0947982b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a46414a-f727-449f-82d9-3c0947982b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c54241-5173-4eaf-9cbd-cb8cc7ac9583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23c54241-5173-4eaf-9cbd-cb8cc7ac9583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '909f9628-bba7-43f9-a4f9-86df2b2df18e', 'volume_name': 'volume-909f9628-bba7-43f9-a4f9-86df2b2df18e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f89ab9f-a301-475f-b90b-2d230ed036e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f89ab9f-a301-475f-b90b-2d230ed036e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b06161e-b4a8-415f-b2ed-af2327dbaf2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:10 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Volume 909f9628-bba7-43f9-a4f9-86df2b2df18e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-909f9628-bba7-43f9-a4f9-86df2b2df18e', 'volume_size': 1} Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:10 devstack sudo[100037]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a94908b4-0096-4bdf-995f-0a693bbf80c0 1073741824" returned: 0 in 1.022s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a94908b4-0096-4bdf-995f-0a693bbf80c0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:10 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a94908b4-0096-4bdf-995f-0a693bbf80c0 Sep 29 18:47:10 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:11 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a94908b4-0096-4bdf-995f-0a693bbf80c0" returned: 0 in 0.299s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] <== create_volume: return (1393ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.399s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.429s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1901539342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=909f9628-bba7-43f9-a4f9-86df2b2df18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e22c1568584b3394f82865e86769b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:10Z,use_quota=True,user_id='e7a46f6068154174a6d0db44e20e5bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Creating volume 909f9628-bba7-43f9-a4f9-86df2b2df18e {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:11 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0199ddc6-306a-4839-aacc-2f30e2d204f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94908b4-0096-4bdf-995f-0a693bbf80c0', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd30bb4f-1dd1-4e6f-8497-34d06b79cac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:11 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e 1073741824 Sep 29 18:47:11 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:11 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Volume volume-a94908b4-0096-4bdf-995f-0a693bbf80c0 (a94908b4-0096-4bdf-995f-0a693bbf80c0): created successfully Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd30bb4f-1dd1-4e6f-8497-34d06b79cac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Flow 'volume_create_manager' (074ca11c-2602-4cf2-af53-d38b6c4332b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:11 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3afbf294-5a9c-41a9-816e-b241ec747f16 tempest-CreateVolumesFromSnapshotTest-62300794 None] Created volume successfully. Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-a94908b4-0096-4bdf-995f-0a693bbf80c0-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-a94908b4-0096-4bdf-995f-0a693bbf80c0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-quobyte-a94908b4-0096-4bdf-995f-0a693bbf80c0" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-a94908b4-0096-4bdf-995f-0a693bbf80c0" acquired by "delete_volume" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f417ec9-a60b-412d-a35a-a0a61adc26fe]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a94908b4-0096-4bdf-995f-0a693bbf80c0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:11 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e 1073741824" returned: 0 in 0.697s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:11 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a94908b4-0096-4bdf-995f-0a693bbf80c0 Sep 29 18:47:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:11 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:11 devstack sudo[100095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e Sep 29 18:47:11 devstack sudo[100095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:12 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a94908b4-0096-4bdf-995f-0a693bbf80c0" returned: 0 in 0.542s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a94908b4-0096-4bdf-995f-0a693bbf80c0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:12 devstack sudo[100095]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e" returned: 0 in 0.471s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] <== create_volume: return (1233ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:12 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a94908b4-0096-4bdf-995f-0a693bbf80c0 Sep 29 18:47:12 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b06161e-b4a8-415f-b2ed-af2327dbaf2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-909f9628-bba7-43f9-a4f9-86df2b2df18e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78437302-f456-4c78-9b04-344a19fff3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:12 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Volume volume-909f9628-bba7-43f9-a4f9-86df2b2df18e (909f9628-bba7-43f9-a4f9-86df2b2df18e): created successfully Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78437302-f456-4c78-9b04-344a19fff3d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (d503fd1e-245e-41f7-af8b-d231ee79675f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:12 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3a6fe87b-627d-4751-94e7-ab360286132e tempest-VolumesGetTest-1497843584 None] Created volume successfully. Sep 29 18:47:12 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a94908b4-0096-4bdf-995f-0a693bbf80c0" returned: 0 in 0.368s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-a94908b4-0096-4bdf-995f-0a693bbf80c0" released by "delete_volume" :: held 0.970s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Created reservations ['ffc6d5f0-0a68-4837-bf12-72af17b07ae8', '0705ae3b-2c09-4418-9413-c7c872920296', '32cc5954-3d37-46cb-a777-bdb3d9f56e9c', '00042b4f-f3f9-418c-9242-f00448b27a09'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:12 devstack sudo[100106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:12 devstack sudo[100106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:13 devstack sudo[100106]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.325s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:13 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Deleted volume successfully. Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aecbdd1d-cd20-4bca-bd46-5f90bdfcb02e tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-a94908b4-0096-4bdf-995f-0a693bbf80c0-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Flow 'volume_create_manager' (8579456d-1303-4b59-8410-263e2c85fce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383c1f50-f5c6-4cc0-826c-84505a89a546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (383c1f50-f5c6-4cc0-826c-84505a89a546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1003101843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf4b573b-e12c-4578-8d65-1e47d980e6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081073a0585649779ac6c5b1662af0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:14Z,use_quota=True,user_id='117052e14ecc4ddda8fdab9a9847cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530a0d1a-cb21-4cec-9b5d-77798dcc16f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530a0d1a-cb21-4cec-9b5d-77798dcc16f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf806b6-0d1d-4708-8ea3-01914f3678f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adf806b6-0d1d-4708-8ea3-01914f3678f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf4b573b-e12c-4578-8d65-1e47d980e6ea', 'volume_name': 'volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf3f992-3701-4840-acec-b117709fa4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccf3f992-3701-4840-acec-b117709fa4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee5c61f-d3b3-4c06-b0b2-52a5f2b96781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:13 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Volume bf4b573b-e12c-4578-8d65-1e47d980e6ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea', 'volume_size': 1} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1003101843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf4b573b-e12c-4578-8d65-1e47d980e6ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081073a0585649779ac6c5b1662af0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:14Z,use_quota=True,user_id='117052e14ecc4ddda8fdab9a9847cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Creating volume bf4b573b-e12c-4578-8d65-1e47d980e6ea {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:13 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-b8f0915b-a633-4e45-b9c2-232514867175-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:13 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea 1073741824 Sep 29 18:47:13 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-b8f0915b-a633-4e45-b9c2-232514867175-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-quobyte-b8f0915b-a633-4e45-b9c2-232514867175" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-b8f0915b-a633-4e45-b9c2-232514867175" acquired by "delete_volume" :: waited 0.041s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50a6123-5253-4954-a598-4a57f8780a9c]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b8f0915b-a633-4e45-b9c2-232514867175 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:14 devstack sudo[100112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b8f0915b-a633-4e45-b9c2-232514867175 Sep 29 18:47:14 devstack sudo[100112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (7cfe1968-b653-4bbd-83e5-14c44588ec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e5d1df-7859-44bb-8da0-47e5cecc3bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8e5d1df-7859-44bb-8da0-47e5cecc3bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1458885797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0046c055-ecf5-44de-946f-cd37643671a1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='24e22c1568584b3394f82865e86769b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=909f9628-bba7-43f9-a4f9-86df2b2df18e,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:14Z,use_quota=True,user_id='e7a46f6068154174a6d0db44e20e5bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae09bdfb-bf59-4976-91dc-e224c2bffd99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae09bdfb-bf59-4976-91dc-e224c2bffd99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576f3fa3-bc85-429e-8c8a-fbd1f72991fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (576f3fa3-bc85-429e-8c8a-fbd1f72991fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '0046c055-ecf5-44de-946f-cd37643671a1', 'volume_name': 'volume-0046c055-ecf5-44de-946f-cd37643671a1', 'volume_size': 1, 'source_volid': '909f9628-bba7-43f9-a4f9-86df2b2df18e', 'source_volstatus': 'available'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd36b84-80ba-490c-8ec8-f0ece0407c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dd36b84-80ba-490c-8ec8-f0ece0407c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb025aeb-58e0-47e6-b717-0ab0e9fa8a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:14 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Volume 0046c055-ecf5-44de-946f-cd37643671a1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-0046c055-ecf5-44de-946f-cd37643671a1', 'volume_size': 1, 'source_volid': '909f9628-bba7-43f9-a4f9-86df2b2df18e', 'source_volstatus': 'available'} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:14 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea 1073741824" returned: 0 in 0.879s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:14 devstack sudo[100112]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b8f0915b-a633-4e45-b9c2-232514867175" returned: 0 in 0.630s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b8f0915b-a633-4e45-b9c2-232514867175 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:14 devstack sudo[100121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea Sep 29 18:47:14 devstack sudo[100121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:14 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b8f0915b-a633-4e45-b9c2-232514867175 Sep 29 18:47:14 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:15 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b8f0915b-a633-4e45-b9c2-232514867175" returned: 0 in 0.287s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-b8f0915b-a633-4e45-b9c2-232514867175" released by "delete_volume" :: held 1.013s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:15 devstack sudo[100121]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea" returned: 0 in 0.352s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] <== create_volume: return (1290ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.293s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.426s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:15 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Cloning volume 909f9628-bba7-43f9-a4f9-86df2b2df18e to volume 0046c055-ecf5-44de-946f-cd37643671a1 Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ee5c61f-d3b3-4c06-b0b2-52a5f2b96781) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1254c48a-8725-4857-915a-a48cb2eb32a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:15 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Volume volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea (bf4b573b-e12c-4578-8d65-1e47d980e6ea): created successfully Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1254c48a-8725-4857-915a-a48cb2eb32a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Flow 'volume_create_manager' (8579456d-1303-4b59-8410-263e2c85fce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Creating offline snapshot 8ee267c6-0886-43be-bb0e-83260412dfe0 of volume 909f9628-bba7-43f9-a4f9-86df2b2df18e {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:47:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7cf396b4-5053-412b-af20-cd4e63eb136c tempest-VolumesActionsTest-348868115 None] Created volume successfully. Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[869a12fe-e0d1-4da9-87d0-8806398970aa]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Created reservations ['98f77b8b-1d66-4482-a112-31505a37192d', 'f99d777d-a33e-4672-acbb-e53cabaf48df', '6ec8d2f7-586f-4754-bfd9-2fe7991c1d19', 'f2f2a669-f9ab-493d-ac88-caf0aaee226e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:15 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:15 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:15 devstack sudo[100127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e Sep 29 18:47:15 devstack sudo[100127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:15 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.359s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Deleted volume successfully. Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9b9db4e6-7c22-4454-962a-4eee5abfec83 tempest-VolumesActionsTest-348868115 None] Acquiring lock "cinder-bf4b573b-e12c-4578-8d65-1e47d980e6ea" by "attach_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:15 devstack sudo[100127]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9b9db4e6-7c22-4454-962a-4eee5abfec83 tempest-VolumesActionsTest-348868115 None] Lock "cinder-bf4b573b-e12c-4578-8d65-1e47d980e6ea" acquired by "attach_volume" :: waited 0.035s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5fee0ffa-8199-415f-aa3e-3b3ca88b765c tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-b8f0915b-a633-4e45-b9c2-232514867175-delete_volume" released by "delete_volume" :: held 1.844s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e" returned: 0 in 0.584s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:15 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 1G Sep 29 18:47:15 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-9b9db4e6-7c22-4454-962a-4eee5abfec83 tempest-VolumesActionsTest-348868115 None] Attaching volume bf4b573b-e12c-4578-8d65-1e47d980e6ea to instance 4952d72c-4fd9-4e59-892f-df8bd8e5be5e at mountpoint /dev/vdb on host None. Sep 29 18:47:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-9b9db4e6-7c22-4454-962a-4eee5abfec83 tempest-VolumesActionsTest-348868115 None] Attach volume completed successfully. Sep 29 18:47:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9b9db4e6-7c22-4454-962a-4eee5abfec83 tempest-VolumesActionsTest-348868115 None] Lock "cinder-bf4b573b-e12c-4578-8d65-1e47d980e6ea" released by "attach_volume" :: held 0.145s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:16 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 1G" returned: 0 in 0.578s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909f9628-bba7-43f9-a4f9-86df2b2df18e -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:16 devstack sudo[100140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909f9628-bba7-43f9-a4f9-86df2b2df18e -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 Sep 29 18:47:16 devstack sudo[100140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-d1580633-65f9-4fdf-89d2-00bf68f1d0d0-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-d1580633-65f9-4fdf-89d2-00bf68f1d0d0-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Flow 'volume_create_manager' (961b3f86-877a-4a25-82aa-87e07f2a432f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284cb28b-4f35-4936-aaa1-8113a853bcec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-quobyte-d1580633-65f9-4fdf-89d2-00bf68f1d0d0" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:16 devstack sudo[100140]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (284cb28b-4f35-4936-aaa1-8113a853bcec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cec735-fd97-423c-bc31-7acd5229fabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d18222801e3b4b5890da4eb6dd61f31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:17Z,use_quota=True,user_id='9240c714154945d98ce811a12a15e055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5b638f-062d-4966-92b5-6dd286e59bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f5b638f-062d-4966-92b5-6dd286e59bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411ad4c0-f50d-4b47-a194-29dba942a184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG cinder.image.glance [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Creating Keystone auth plugin from conf {{(pid=86523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-909f9628-bba7-43f9-a4f9-86df2b2df18e -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0" returned: 0 in 0.534s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:16 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 is being set with open permissions: ugo+rw Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-d1580633-65f9-4fdf-89d2-00bf68f1d0d0" acquired by "delete_volume" :: waited 0.070s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:16 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 Sep 29 18:47:16 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:16 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8c0ba44a-f342-4834-82d9-788b5d282979 tempest-VolumesActionsTest-501401051 None] Terminate volume connection completed successfully. Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c519c2-1b68-4e1d-86e3-411d1901f694]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8c0ba44a-f342-4834-82d9-788b5d282979 tempest-VolumesActionsTest-501401051 None] Acquiring lock "cinder-bf4b573b-e12c-4578-8d65-1e47d980e6ea-detach_volume" by "detach_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8c0ba44a-f342-4834-82d9-788b5d282979 tempest-VolumesActionsTest-501401051 None] Lock "cinder-bf4b573b-e12c-4578-8d65-1e47d980e6ea-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:17 devstack sudo[100148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0 Sep 29 18:47:17 devstack sudo[100148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:17 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8c0ba44a-f342-4834-82d9-788b5d282979 tempest-VolumesActionsTest-501401051 None] Detaching volume bf4b573b-e12c-4578-8d65-1e47d980e6ea from instance 4952d72c-4fd9-4e59-892f-df8bd8e5be5e. Sep 29 18:47:17 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8c0ba44a-f342-4834-82d9-788b5d282979 tempest-VolumesActionsTest-501401051 None] Detach volume completed successfully. Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8c0ba44a-f342-4834-82d9-788b5d282979 tempest-VolumesActionsTest-501401051 None] Lock "cinder-bf4b573b-e12c-4578-8d65-1e47d980e6ea-detach_volume" released by "detach_volume" :: held 0.152s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (411ad4c0-f50d-4b47-a194-29dba942a184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '97cec735-fd97-423c-bc31-7acd5229fabc', 'volume_name': 'volume-97cec735-fd97-423c-bc31-7acd5229fabc', 'volume_size': 1, 'image_id': 'ee06dded-b10d-4d72-a849-123ccb706135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee06dded-b10d-4d72-a849-123ccb706135', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '08ef35ddb33e5acaf6e4ab0db31c3777', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd18222801e3b4b5890da4eb6dd61f31d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7addff94cfa2c3b839d3d0aa9658b7861b78e73f11cf6a82755469e415023c2da964e881f88796b289882bd7be98cb961d469c00dc52cc413c07bbd7427e8211', 'id': 'ee06dded-b10d-4d72-a849-123ccb706135', 'created_at': datetime.datetime(2026, 9, 29, 16, 47, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 47, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee06dded-b10d-4d72-a849-123ccb706135/file', 'properties': {}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af882752-52c0-4c91-8b77-2c1c0c3b5088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af882752-52c0-4c91-8b77-2c1c0c3b5088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e566c5-f5eb-4714-8782-1d820e6402bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:17 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Volume 97cec735-fd97-423c-bc31-7acd5229fabc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-97cec735-fd97-423c-bc31-7acd5229fabc', 'volume_size': 1, 'image_id': 'ee06dded-b10d-4d72-a849-123ccb706135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee06dded-b10d-4d72-a849-123ccb706135', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '08ef35ddb33e5acaf6e4ab0db31c3777', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd18222801e3b4b5890da4eb6dd61f31d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7addff94cfa2c3b839d3d0aa9658b7861b78e73f11cf6a82755469e415023c2da964e881f88796b289882bd7be98cb961d469c00dc52cc413c07bbd7427e8211', 'id': 'ee06dded-b10d-4d72-a849-123ccb706135', 'created_at': datetime.datetime(2026, 9, 29, 16, 47, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 47, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee06dded-b10d-4d72-a849-123ccb706135/file', 'properties': {}}, 'image_service': } Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Trying to clone 97cec735-fd97-423c-bc31-7acd5229fabc from image ee06dded-b10d-4d72-a849-123ccb706135 at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee06dded-b10d-4d72-a849-123ccb706135', 'metadata': {}}]). {{(pid=86523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:47:17 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0" returned: 0 in 0.435s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:17 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.info Sep 29 18:47:17 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:47:17 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Image download 0.00 MB at 0.00 MB/s Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ea7492f-96ed-4898-a31b-2fe422987be2]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ee120dcb-abe0-465c-b606-9b31f7d95ccd tempest-VolumesActionsTest-348868115 None] Acquiring lock "cinder-bf4b573b-e12c-4578-8d65-1e47d980e6ea-detach_volume" by "detach_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:17 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ee120dcb-abe0-465c-b606-9b31f7d95ccd tempest-VolumesActionsTest-348868115 None] Lock "cinder-bf4b573b-e12c-4578-8d65-1e47d980e6ea-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:17 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ee120dcb-abe0-465c-b606-9b31f7d95ccd tempest-VolumesActionsTest-348868115 None] Volume detach called, but volume not attached. Sep 29 18:47:17 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:17 devstack sudo[100148]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0" returned: 0 in 0.707s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ee120dcb-abe0-465c-b606-9b31f7d95ccd tempest-VolumesActionsTest-348868115 None] Lock "cinder-bf4b573b-e12c-4578-8d65-1e47d980e6ea-detach_volume" released by "detach_volume" :: held 0.040s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:17 devstack sudo[100158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0 Sep 29 18:47:17 devstack sudo[100158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:17 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.info" returned: 0 in 0.531s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:17 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.info is being set with open permissions: ugo+rw Sep 29 18:47:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:17 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.info Sep 29 18:47:17 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:18 devstack sudo[100158]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d1580633-65f9-4fdf-89d2-00bf68f1d0d0" returned: 0 in 0.334s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-d1580633-65f9-4fdf-89d2-00bf68f1d0d0" released by "delete_volume" :: held 1.121s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:18 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD" returned: 0 in 0.574s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Acquiring lock "cinder-bf4b573b-e12c-4578-8d65-1e47d980e6ea-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Lock "cinder-bf4b573b-e12c-4578-8d65-1e47d980e6ea-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Created reservations ['79692bcd-1714-49e4-89e5-884aed3339b2', 'db96a768-5794-47a5-ba7d-0596e138f2bc', '1e99895b-36fa-4a61-b12e-37c8cf3f5c6c', 'ba17052f-82f4-47c4-8162-46a3bf9f0ef9'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:18 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD Sep 29 18:47:18 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Acquiring lock "cinder-quobyte-bf4b573b-e12c-4578-8d65-1e47d980e6ea" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Lock "cinder-quobyte-bf4b573b-e12c-4578-8d65-1e47d980e6ea" acquired by "delete_volume" :: waited 0.034s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:18 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.info" returned: 0 in 0.410s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-quobyte-0046c055-ecf5-44de-946f-cd37643671a1" by "_copy_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9358fb60-333c-4da7-9234-d1b4bd776912]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-0046c055-ecf5-44de-946f-cd37643671a1" acquired by "_copy_volume_from_snapshot" :: waited 0.050s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] snapshot: 8ee267c6-0886-43be-bb0e-83260412dfe0, volume: 0046c055-ecf5-44de-946f-cd37643671a1, {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3a8b80-6ec9-4205-beb4-7a57941af145]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:18 devstack sudo[100170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:18 devstack sudo[100170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:18 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea Sep 29 18:47:18 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:18 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD" returned: 1 in 0.495s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Temporary image ee06dded-b10d-4d72-a849-123ccb706135 is fetched for user 9240c714154945d98ce811a12a15e055. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:47:18 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 Sep 29 18:47:18 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3802ba-1778-49ee-aaed-66a50ffc5d45]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:18 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea" returned: 0 in 0.514s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:18 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea Sep 29 18:47:18 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:18 devstack sudo[100170]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.469s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:18 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:18 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Deleted volume successfully. Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f2925ee8-02c1-41ea-8115-b952cddb45ca tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-d1580633-65f9-4fdf-89d2-00bf68f1d0d0-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:19 devstack sudo[100181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD Sep 29 18:47:19 devstack sudo[100181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:19 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0" returned: 0 in 0.651s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-909f9628-bba7-43f9-a4f9-86df2b2df18e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-f74ff29f-41d4-4c6d-9037-7e7750b959d9-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0887dfe-9d19-4fac-936b-547d48dae12e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:19 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-f74ff29f-41d4-4c6d-9037-7e7750b959d9-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bf4b573b-e12c-4578-8d65-1e47d980e6ea" returned: 0 in 0.332s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Lock "cinder-quobyte-bf4b573b-e12c-4578-8d65-1e47d980e6ea" released by "delete_volume" :: held 0.950s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:19 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e Sep 29 18:47:19 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-quobyte-f74ff29f-41d4-4c6d-9037-7e7750b959d9" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-f74ff29f-41d4-4c6d-9037-7e7750b959d9" acquired by "delete_volume" :: waited 0.049s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9ab829-cc37-461f-8ce9-f09b4e9ce53a]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Created reservations ['37e71920-d1cf-4bf0-a1ec-ba96985ef8f0', 'f22c81dd-3013-4008-b94d-446e825cf808', 'e8e07298-234c-4b99-9469-55fcada76e16', '37c5ab05-5fc0-4d66-b4dc-0b5c2da9e97a'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:19 devstack sudo[100181]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD" returned: 0 in 0.728s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:19 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e" returned: 0 in 0.472s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Creating direct copy from snapshot {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG cinder.utils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Path /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1 not found in is_blk_device check {{(pid=86523) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:19 devstack sudo[100193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9 Sep 29 18:47:19 devstack sudo[100193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:19 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1 Sep 29 18:47:19 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:19 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD Sep 29 18:47:19 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:19 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:19 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:20 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD" returned: 1 in 0.589s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:47:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:20 devstack sudo[100193]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9" returned: 0 in 0.710s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:20 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9 Sep 29 18:47:20 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:20 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.559s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:20 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Deleted volume successfully. Sep 29 18:47:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7f540145-be16-4209-9c1a-20d4b2b4083f tempest-VolumesActionsTest-348868115 None] Lock "cinder-bf4b573b-e12c-4578-8d65-1e47d980e6ea-delete_volume" released by "delete_volume" :: held 2.256s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:20 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f74ff29f-41d4-4c6d-9037-7e7750b959d9" returned: 0 in 0.650s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-f74ff29f-41d4-4c6d-9037-7e7750b959d9" released by "delete_volume" :: held 1.450s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:21 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Created reservations ['6d942e12-d1a0-494f-9ce3-318cd408e4c8', '83260847-8ea6-42e0-a52e-6803dce1b5e0', 'd609980a-3265-41c6-ac1b-30f45258ab5a', 'f877f5dc-b7f9-45f6-b935-46356e43492f'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:21 devstack sudo[100228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:21 devstack sudo[100228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:21 devstack sudo[100228]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.437s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:21 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:21 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Deleted volume successfully. Sep 29 18:47:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da47985f-e1c2-4c50-b39d-391dfd74616a tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-f74ff29f-41d4-4c6d-9037-7e7750b959d9-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-quobyte-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4" acquired by "delete_volume" :: waited 0.054s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a05861-835c-4af1-ad5f-cc8fc7c91724]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:22 devstack sudo[100255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4 Sep 29 18:47:22 devstack sudo[100255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:23 devstack sudo[100255]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4" returned: 0 in 1.237s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:23 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4 Sep 29 18:47:23 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:24 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4" returned: 0 in 0.692s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4" released by "delete_volume" :: held 2.060s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:24 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Created reservations ['e8b9a4ba-d747-4d9a-8e13-dfa697a25dd8', 'd4d38e91-72d3-4dbb-8e32-8872f193f467', '625c08b7-1a1f-40ea-a95d-bf7626a834cc', '6980dbf1-774e-4a2d-921f-68c622c91fd9'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:24 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:24 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:25 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.424s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:25 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Deleted volume successfully. Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-337444a6-a4a8-4e89-8cea-69ccfb00c88e tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-dc7790e6-e6f0-4ccf-ac3f-5a6ad707c1c4-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-267cba80-f0d3-40d8-bdff-5537a0608567-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-267cba80-f0d3-40d8-bdff-5537a0608567-delete_snapshot" acquired by "delete_snapshot" :: waited 0.059s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-quobyte-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-quobyte-267cba80-f0d3-40d8-bdff-5537a0608567" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-267cba80-f0d3-40d8-bdff-5537a0608567" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Deleting offline snapshot 267cba80-f0d3-40d8-bdff-5537a0608567 of volume 9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] snapshot_file for this snap is: volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3f36ab-02b9-4702-a9e7-c34694c799ab]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:25 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Flow 'volume_create_manager' (2a700818-ede6-4ef7-beda-5b444862d04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee580dc-06b0-44d2-831b-54c73241b32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ee580dc-06b0-44d2-831b-54c73241b32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1749305137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69bfc795-3254-4b67-8398-f7b3ace4d064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081073a0585649779ac6c5b1662af0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:26Z,use_quota=True,user_id='117052e14ecc4ddda8fdab9a9847cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fea7c01-d550-4e42-87a0-a1af025de2e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fea7c01-d550-4e42-87a0-a1af025de2e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83493303-71b4-4f30-a11c-3d7ffd155a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83493303-71b4-4f30-a11c-3d7ffd155a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69bfc795-3254-4b67-8398-f7b3ace4d064', 'volume_name': 'volume-69bfc795-3254-4b67-8398-f7b3ace4d064', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdeb869a-9269-4c85-8588-04222a54536f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdeb869a-9269-4c85-8588-04222a54536f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ef443f-51d3-4144-b101-69cc27c61405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:26 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Volume 69bfc795-3254-4b67-8398-f7b3ace4d064: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69bfc795-3254-4b67-8398-f7b3ace4d064', 'volume_size': 1} Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:26 devstack sudo[100271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 Sep 29 18:47:26 devstack sudo[100271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:26 devstack sudo[100271]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567" returned: 0 in 0.921s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d32a2d-28da-442d-8e8a-15572e12b663]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:27 devstack sudo[100276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 Sep 29 18:47:27 devstack sudo[100276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:27 devstack sudo[100276]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393" returned: 0 in 0.548s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:27 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 Sep 29 18:47:27 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:28 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567" returned: 0 in 0.617s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:28 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567 Sep 29 18:47:28 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:28 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1" returned: 0 in 8.681s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e, size 1024.00 MB, duration 8.68 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:47:28 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Converted 1024.00 MB image at 117.94 MB/s Sep 29 18:47:28 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1 is being set with open permissions: ugo+rw Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:28 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393.267cba80-f0d3-40d8-bdff-5537a0608567" returned: 0 in 0.332s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:28 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1 Sep 29 18:47:28 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-267cba80-f0d3-40d8-bdff-5537a0608567" released by "_delete_snapshot" :: held 2.647s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393" released by "delete_snapshot" :: held 2.691s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Created reservations ['cbbda668-b060-450f-b1af-095a453b7add', '4c271a73-71dc-44d6-bcd6-0cfbd34da981', '324c030b-2bec-4873-a964-d2f29b82dff9', '8899fc64-b2ff-4962-9879-b26c4e6b95c7'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:28 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Delete snapshot completed successfully. Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-922cd74e-d554-4343-a028-1d5111977174 tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-267cba80-f0d3-40d8-bdff-5537a0608567-delete_snapshot" released by "delete_snapshot" :: held 2.856s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:28 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1" returned: 0 in 0.252s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-0046c055-ecf5-44de-946f-cd37643671a1" released by "_copy_volume_from_snapshot" :: held 10.187s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-quobyte-8ee267c6-0886-43be-bb0e-83260412dfe0" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-8ee267c6-0886-43be-bb0e-83260412dfe0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Deleting offline snapshot 8ee267c6-0886-43be-bb0e-83260412dfe0 of volume 909f9628-bba7-43f9-a4f9-86df2b2df18e {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] snapshot_file for this snap is: volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e1c7e8-da99-4ae2-87c6-8a14b308ed5e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:28 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 Sep 29 18:47:28 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "cinder-quobyte-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad24d299-fe72-49b9-8273-7a1143226845]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:29 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0" returned: 0 in 0.368s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-909f9628-bba7-43f9-a4f9-86df2b2df18e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[81dfa723-605e-4bbd-85a4-858175c32b12]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:29 devstack sudo[100298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 Sep 29 18:47:29 devstack sudo[100298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:29 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e Sep 29 18:47:29 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:29 devstack sudo[100298]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393" returned: 0 in 0.376s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:29 devstack sudo[100307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393 Sep 29 18:47:29 devstack sudo[100307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:29 devstack sudo[100307]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393" returned: 0 in 0.252s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:29 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e" returned: 0 in 0.570s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-quobyte-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393" released by "delete_volume" :: held 0.704s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:29 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 Sep 29 18:47:29 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Created reservations ['6554a7d0-02aa-4378-b186-3188802628f0', '8f5bd23f-ae35-4a44-a46d-378584060569', '806090c7-2cb8-429c-957c-db298a44f230', 'b614968e-c751-41f6-a90e-8ed59d3b9548'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:29 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:29 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:29 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0" returned: 0 in 0.332s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:30 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0 Sep 29 18:47:30 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:30 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.281s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Deleted volume successfully. Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-27f963d6-62b9-44cc-90fb-cc1974537fee tempest-CreateVolumesFromSnapshotTest-62300794 None] Lock "cinder-9fe9afb5-e8eb-458a-9bad-7d9cb97a4393-delete_volume" released by "delete_volume" :: held 1.194s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:30 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e.8ee267c6-0886-43be-bb0e-83260412dfe0" returned: 0 in 0.276s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-8ee267c6-0886-43be-bb0e-83260412dfe0" released by "_delete_snapshot" :: held 1.652s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.184s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.174s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:16Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97cec735-fd97-423c-bc31-7acd5229fabc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d18222801e3b4b5890da4eb6dd61f31d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:17Z,use_quota=True,user_id='9240c714154945d98ce811a12a15e055',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Creating volume 97cec735-fd97-423c-bc31-7acd5229fabc {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:30 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:30 devstack sudo[100323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc 1073741824 Sep 29 18:47:30 devstack sudo[100323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb025aeb-58e0-47e6-b717-0ab0e9fa8a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0046c055-ecf5-44de-946f-cd37643671a1', 'volume_size': 1, 'source_volid': '909f9628-bba7-43f9-a4f9-86df2b2df18e', 'source_volstatus': 'available'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400e6f77-f5c1-45a5-a894-d52e03888a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:30 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Volume volume-0046c055-ecf5-44de-946f-cd37643671a1 (0046c055-ecf5-44de-946f-cd37643671a1): created successfully Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (400e6f77-f5c1-45a5-a894-d52e03888a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (7cfe1968-b653-4bbd-83e5-14c44588ec53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-9b3b7ce0-cfb2-419e-84ea-2224011ae012 tempest-VolumesGetTest-1497843584 None] Created volume successfully. Sep 29 18:47:30 devstack sudo[100323]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc 1073741824" returned: 0 in 0.484s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:30 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc Sep 29 18:47:30 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:31 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc" returned: 0 in 0.247s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.912s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1749305137',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69bfc795-3254-4b67-8398-f7b3ace4d064,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081073a0585649779ac6c5b1662af0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:26Z,use_quota=True,user_id='117052e14ecc4ddda8fdab9a9847cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Creating volume 69bfc795-3254-4b67-8398-f7b3ace4d064 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:31 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69bfc795-3254-4b67-8398-f7b3ace4d064 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:31 devstack sudo[100333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69bfc795-3254-4b67-8398-f7b3ace4d064 1073741824 Sep 29 18:47:31 devstack sudo[100333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Attempting download of ee06dded-b10d-4d72-a849-123ccb706135 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee06dded-b10d-4d72-a849-123ccb706135', 'metadata': {}}])) to volume 97cec735-fd97-423c-bc31-7acd5229fabc. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9f3fb1-04ec-49c8-902d-269df9ad1e8d]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee06dded-b10d-4d72-a849-123ccb706135_ia08ji9a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:31 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee06dded-b10d-4d72-a849-123ccb706135_ia08ji9a Sep 29 18:47:31 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:31 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee06dded-b10d-4d72-a849-123ccb706135_ia08ji9a" returned: 0 in 0.441s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee06dded-b10d-4d72-a849-123ccb706135_ia08ji9a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:31 devstack sudo[100333]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69bfc795-3254-4b67-8398-f7b3ace4d064 1073741824" returned: 0 in 0.637s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:31 devstack sudo[100343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee06dded-b10d-4d72-a849-123ccb706135_ia08ji9a Sep 29 18:47:31 devstack sudo[100343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69bfc795-3254-4b67-8398-f7b3ace4d064 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:31 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69bfc795-3254-4b67-8398-f7b3ace4d064 Sep 29 18:47:31 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:32 devstack sudo[100343]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee06dded-b10d-4d72-a849-123ccb706135_ia08ji9a" returned: 1 in 0.478s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee06dded-b10d-4d72-a849-123ccb706135_ia08ji9a' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3231ce2d-3a64-4f6a-bf34-b0af1d81d87d]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:32 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69bfc795-3254-4b67-8398-f7b3ace4d064" returned: 0 in 0.439s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] <== create_volume: return (1142ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03ef443f-51d3-4144-b101-69cc27c61405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69bfc795-3254-4b67-8398-f7b3ace4d064', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999417a4-d230-4991-bc55-929c7b2b2f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:32 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD Sep 29 18:47:32 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (5e1e8905-ddf8-4485-8fd3-6a6f0ea6bf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1dd0e7-db87-4778-aebf-e507d46276d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:32 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Volume volume-69bfc795-3254-4b67-8398-f7b3ace4d064 (69bfc795-3254-4b67-8398-f7b3ace4d064): created successfully Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999417a4-d230-4991-bc55-929c7b2b2f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Flow 'volume_create_manager' (2a700818-ede6-4ef7-beda-5b444862d04e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f1dd0e7-db87-4778-aebf-e507d46276d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-719621425',display_name='tempest-VolumesGetTest-Volume-576350270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3115f0-7bf3-461b-a03b-c9853cecc9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e22c1568584b3394f82865e86769b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:32Z,use_quota=True,user_id='e7a46f6068154174a6d0db44e20e5bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e3b5a0-0670-4f6c-8c6a-3d361b7d16db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e3b5a0-0670-4f6c-8c6a-3d361b7d16db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcf73ce-b1c7-4b1c-9963-7029f40a5039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfcf73ce-b1c7-4b1c-9963-7029f40a5039) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e3115f0-7bf3-461b-a03b-c9853cecc9dc', 'volume_name': 'volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e6c3ac-414a-43ee-abfb-722b6b929d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e6c3ac-414a-43ee-abfb-722b6b929d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c62fae2-9408-41d0-8eee-40518203d1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:32 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Volume 9e3115f0-7bf3-461b-a03b-c9853cecc9dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc', 'volume_size': 1} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-719621425',display_name='tempest-VolumesGetTest-Volume-576350270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e3115f0-7bf3-461b-a03b-c9853cecc9dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e22c1568584b3394f82865e86769b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:32Z,use_quota=True,user_id='e7a46f6068154174a6d0db44e20e5bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Creating volume 9e3115f0-7bf3-461b-a03b-c9853cecc9dc {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:32 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:32 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-fb392fbd-277b-4235-8bba-cd08932d25a8 tempest-VolumesActionsTest-348868115 None] Created volume successfully. Sep 29 18:47:32 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc 1073741824 Sep 29 18:47:32 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:32 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD" returned: 0 in 0.399s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:32 devstack sudo[100356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD Sep 29 18:47:32 devstack sudo[100356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:32 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc 1073741824" returned: 0 in 0.494s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:32 devstack sudo[100356]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD" returned: 1 in 0.374s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] ee06dded-b10d-4d72-a849-123ccb706135 was raw, converting to qcow2 {{(pid=86523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:32 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc Sep 29 18:47:32 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:33 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc Sep 29 18:47:33 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:33 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc" returned: 0 in 0.300s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c62fae2-9408-41d0-8eee-40518203d1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3883d56-a157-4ea6-95bb-c905987a4268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:33 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Volume volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc (9e3115f0-7bf3-461b-a03b-c9853cecc9dc): created successfully Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3883d56-a157-4ea6-95bb-c905987a4268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (5e1e8905-ddf8-4485-8fd3-6a6f0ea6bf31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Acquiring lock "cinder-69bfc795-3254-4b67-8398-f7b3ace4d064-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:33 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1b829e04-27a4-4550-b318-20c4eeee1d34 tempest-VolumesGetTest-1497843584 None] Created volume successfully. Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Lock "cinder-69bfc795-3254-4b67-8398-f7b3ace4d064-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Acquiring lock "cinder-quobyte-69bfc795-3254-4b67-8398-f7b3ace4d064" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Lock "cinder-quobyte-69bfc795-3254-4b67-8398-f7b3ace4d064" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba4caa54-f3db-44d8-9454-9d75d49a40e8]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69bfc795-3254-4b67-8398-f7b3ace4d064 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:33 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc" returned: 0 in 0.635s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee06dded-b10d-4d72-a849-123ccb706135_8gke2h64devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:47:33 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:33 devstack sudo[100375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69bfc795-3254-4b67-8398-f7b3ace4d064 Sep 29 18:47:33 devstack sudo[100375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:33 devstack sudo[100376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc 1G Sep 29 18:47:33 devstack sudo[100376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:33 devstack sudo[100375]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69bfc795-3254-4b67-8398-f7b3ace4d064" returned: 0 in 0.411s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69bfc795-3254-4b67-8398-f7b3ace4d064 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:33 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69bfc795-3254-4b67-8398-f7b3ace4d064 Sep 29 18:47:33 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:33 devstack sudo[100376]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc 1G" returned: 0 in 0.355s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Downloaded image ee06dded-b10d-4d72-a849-123ccb706135 ((None, [{'url': 'file:///opt/stack/data/glance/images/ee06dded-b10d-4d72-a849-123ccb706135', 'metadata': {}}])) to volume 97cec735-fd97-423c-bc31-7acd5229fabc successfully. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Temporary image ee06dded-b10d-4d72-a849-123ccb706135 for user 9240c714154945d98ce811a12a15e055 is deleted. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Marking volume 97cec735-fd97-423c-bc31-7acd5229fabc as bootable. {{(pid=86523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Copying metadata from image ee06dded-b10d-4d72-a849-123ccb706135 to 97cec735-fd97-423c-bc31-7acd5229fabc. {{(pid=86523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:47:33 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Creating volume glance metadata for volume 97cec735-fd97-423c-bc31-7acd5229fabc backed by image ee06dded-b10d-4d72-a849-123ccb706135 with: {'image_id': 'ee06dded-b10d-4d72-a849-123ccb706135', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '08ef35ddb33e5acaf6e4ab0db31c3777', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4e566c5-f5eb-4714-8782-1d820e6402bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97cec735-fd97-423c-bc31-7acd5229fabc', 'volume_size': 1, 'image_id': 'ee06dded-b10d-4d72-a849-123ccb706135', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee06dded-b10d-4d72-a849-123ccb706135', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '08ef35ddb33e5acaf6e4ab0db31c3777', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd18222801e3b4b5890da4eb6dd61f31d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7addff94cfa2c3b839d3d0aa9658b7861b78e73f11cf6a82755469e415023c2da964e881f88796b289882bd7be98cb961d469c00dc52cc413c07bbd7427e8211', 'id': 'ee06dded-b10d-4d72-a849-123ccb706135', 'created_at': datetime.datetime(2026, 9, 29, 16, 47, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 47, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee06dded-b10d-4d72-a849-123ccb706135/file', 'properties': {}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33181ca8-2efa-4c90-8614-e3a7c5aae587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:34 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Volume volume-97cec735-fd97-423c-bc31-7acd5229fabc (97cec735-fd97-423c-bc31-7acd5229fabc): created successfully Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33181ca8-2efa-4c90-8614-e3a7c5aae587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Flow 'volume_create_manager' (961b3f86-877a-4a25-82aa-87e07f2a432f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:34 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1ce67cbb-5c7f-4a85-b7c3-6a2ebf8b4301 tempest-VolumeImageDependencyTests-653971304 None] Created volume successfully. Sep 29 18:47:34 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69bfc795-3254-4b67-8398-f7b3ace4d064" returned: 0 in 0.295s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Lock "cinder-quobyte-69bfc795-3254-4b67-8398-f7b3ace4d064" released by "delete_volume" :: held 0.772s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Created reservations ['f6d3b11d-e5bc-4014-845d-659ab587d08a', '9215e16c-0146-44f2-b3f0-793be862ee29', '8b905cb5-3c86-4e4d-a97e-05f9c26415cc', '9f9e0a75-2964-4944-b307-6760a1cfa347'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:34 devstack sudo[100391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:34 devstack sudo[100391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Flow 'volume_create_manager' (ab2f0b8c-aedb-4c71-bd89-6cb9008e5bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba50228-3bfb-4e19-afef-b4a2a7500776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-9e3115f0-7bf3-461b-a03b-c9853cecc9dc-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ba50228-3bfb-4e19-afef-b4a2a7500776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82390342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d325c6-052e-4cae-a23b-490d1f27ffae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c4e77f94d94d558c76cad4883bac8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:34Z,use_quota=True,user_id='cd78075270b046a089143a01b505d1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4c582a-9941-4e49-b114-b98a50f58aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb4c582a-9941-4e49-b114-b98a50f58aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5fd8fc-7497-4e10-9c9f-c635a577d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea5fd8fc-7497-4e10-9c9f-c635a577d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6d325c6-052e-4cae-a23b-490d1f27ffae', 'volume_name': 'volume-b6d325c6-052e-4cae-a23b-490d1f27ffae', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20899695-0482-41fe-8c77-30ff9c0ac950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20899695-0482-41fe-8c77-30ff9c0ac950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e74b6d3-27b1-4e10-8597-e3252b20c1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:34 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Volume b6d325c6-052e-4cae-a23b-490d1f27ffae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6d325c6-052e-4cae-a23b-490d1f27ffae', 'volume_size': 1} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-82390342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d325c6-052e-4cae-a23b-490d1f27ffae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c4e77f94d94d558c76cad4883bac8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:34Z,use_quota=True,user_id='cd78075270b046a089143a01b505d1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Creating volume b6d325c6-052e-4cae-a23b-490d1f27ffae {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:34 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6d325c6-052e-4cae-a23b-490d1f27ffae 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Lock "cinder-9e3115f0-7bf3-461b-a03b-c9853cecc9dc-delete_volume" acquired by "delete_volume" :: waited 0.113s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:34 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6d325c6-052e-4cae-a23b-490d1f27ffae 1073741824 Sep 29 18:47:34 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-quobyte-9e3115f0-7bf3-461b-a03b-c9853cecc9dc" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-9e3115f0-7bf3-461b-a03b-c9853cecc9dc" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[817c1d82-6abb-447d-a264-a80942da2030]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:34 devstack sudo[100391]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.364s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:34 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Deleted volume successfully. Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-16ba00b3-e1e6-4904-8f48-46a7edfbd2d2 tempest-VolumesActionsTest-501401051 None] Lock "cinder-69bfc795-3254-4b67-8398-f7b3ace4d064-delete_volume" released by "delete_volume" :: held 1.439s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:34 devstack sudo[100396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc Sep 29 18:47:34 devstack sudo[100396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Acquiring lock "cinder-97cec735-fd97-423c-bc31-7acd5229fabc-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Lock "cinder-97cec735-fd97-423c-bc31-7acd5229fabc-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Acquiring lock "cinder-quobyte-97cec735-fd97-423c-bc31-7acd5229fabc" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Lock "cinder-quobyte-97cec735-fd97-423c-bc31-7acd5229fabc" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9121b545-1068-4067-a690-f6abe00c5701]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:35 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc Sep 29 18:47:35 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:35 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6d325c6-052e-4cae-a23b-490d1f27ffae 1073741824" returned: 0 in 0.648s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6d325c6-052e-4cae-a23b-490d1f27ffae {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:35 devstack sudo[100396]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc" returned: 0 in 0.607s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:35 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6d325c6-052e-4cae-a23b-490d1f27ffae Sep 29 18:47:35 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:35 devstack sudo[100411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc Sep 29 18:47:35 devstack sudo[100411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Flow 'volume_create_manager' (57dd171b-f8dd-4261-9453-5ce8b7c0055d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08c88d8-6d55-4c82-94f4-ef8b0c4e379f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08c88d8-6d55-4c82-94f4-ef8b0c4e379f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-266559925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557778ea-2135-4a62-b5bd-b088003e62bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081073a0585649779ac6c5b1662af0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:35Z,use_quota=True,user_id='117052e14ecc4ddda8fdab9a9847cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a32902-4ee9-495a-85f8-e4665f971c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a32902-4ee9-495a-85f8-e4665f971c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec87ee6-6dc9-4ea1-a31b-8d19b9b59a53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:35 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dec87ee6-6dc9-4ea1-a31b-8d19b9b59a53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '557778ea-2135-4a62-b5bd-b088003e62bb', 'volume_name': 'volume-557778ea-2135-4a62-b5bd-b088003e62bb', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b5f04f-57a4-4dc8-bbaa-552442487cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50b5f04f-57a4-4dc8-bbaa-552442487cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0d0dd4-c4c5-48f1-8ade-55b49b706cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:35 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Volume 557778ea-2135-4a62-b5bd-b088003e62bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-557778ea-2135-4a62-b5bd-b088003e62bb', 'volume_size': 1} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc" returned: 0 in 0.495s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:35 devstack sudo[100417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc Sep 29 18:47:35 devstack sudo[100417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:35 devstack sudo[100411]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9e3115f0-7bf3-461b-a03b-c9853cecc9dc" returned: 0 in 0.317s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-9e3115f0-7bf3-461b-a03b-c9853cecc9dc" released by "delete_volume" :: held 0.989s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:35 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6d325c6-052e-4cae-a23b-490d1f27ffae" returned: 0 in 0.375s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.147s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-266559925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=557778ea-2135-4a62-b5bd-b088003e62bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081073a0585649779ac6c5b1662af0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:35Z,use_quota=True,user_id='117052e14ecc4ddda8fdab9a9847cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Creating volume 557778ea-2135-4a62-b5bd-b088003e62bb {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:35 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-557778ea-2135-4a62-b5bd-b088003e62bb 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:35 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-557778ea-2135-4a62-b5bd-b088003e62bb 1073741824 Sep 29 18:47:35 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e74b6d3-27b1-4e10-8597-e3252b20c1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d325c6-052e-4cae-a23b-490d1f27ffae', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523d73c4-955a-4691-8320-81a88e31fed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:35 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Volume volume-b6d325c6-052e-4cae-a23b-490d1f27ffae (b6d325c6-052e-4cae-a23b-490d1f27ffae): created successfully Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (523d73c4-955a-4691-8320-81a88e31fed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Flow 'volume_create_manager' (ab2f0b8c-aedb-4c71-bd89-6cb9008e5bd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:35 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-05cf7b66-12a4-47c1-9438-79a836fe482a tempest-ProjectReaderTests-1914606091 None] Created volume successfully. Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Created reservations ['17abbe1c-4254-4fa0-bbf9-f2fa51705eab', '194f99d9-bc65-48eb-b56a-d0f531170127', '6be86ece-e84e-4d3e-9315-06069e9f420f', '381da264-fade-45dc-a12e-95a21286ac35'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:35 devstack sudo[100417]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97cec735-fd97-423c-bc31-7acd5229fabc" returned: 0 in 0.340s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:35 devstack sudo[100424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:35 devstack sudo[100424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Lock "cinder-quobyte-97cec735-fd97-423c-bc31-7acd5229fabc" released by "delete_volume" :: held 0.892s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Created reservations ['a749dd05-25b9-4500-a1bc-a071b370e406', 'f6440b01-0316-418b-bad3-edd1bc75ab42', 'a2a47372-1319-4d93-9f92-c0132a6b17b2', '4554f33c-e8af-4df5-b5e9-974ef87a0657'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:36 devstack sudo[100429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:36 devstack sudo[100429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:36 devstack sudo[100424]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.290s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:36 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Deleted volume successfully. Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f779869c-2a57-4455-a254-3a3e82e01852 tempest-VolumesGetTest-1497843584 None] Lock "cinder-9e3115f0-7bf3-461b-a03b-c9853cecc9dc-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:36 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-557778ea-2135-4a62-b5bd-b088003e62bb 1073741824" returned: 0 in 0.573s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-557778ea-2135-4a62-b5bd-b088003e62bb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:36 devstack sudo[100433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-557778ea-2135-4a62-b5bd-b088003e62bb Sep 29 18:47:36 devstack sudo[100433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:36 devstack sudo[100429]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.357s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:36 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Deleted volume successfully. Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4c9fdc07-edab-4881-952e-3f2c37f8fa52 tempest-VolumeImageDependencyTests-653971304 None] Lock "cinder-97cec735-fd97-423c-bc31-7acd5229fabc-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:36 devstack sudo[100433]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-557778ea-2135-4a62-b5bd-b088003e62bb" returned: 0 in 0.280s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e0d0dd4-c4c5-48f1-8ade-55b49b706cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-557778ea-2135-4a62-b5bd-b088003e62bb', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149aa24d-5e52-4b05-b887-d5cda3b2b72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:36 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Volume volume-557778ea-2135-4a62-b5bd-b088003e62bb (557778ea-2135-4a62-b5bd-b088003e62bb): created successfully Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (149aa24d-5e52-4b05-b887-d5cda3b2b72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Flow 'volume_create_manager' (57dd171b-f8dd-4261-9453-5ce8b7c0055d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:36 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-65ee1675-1186-4908-b653-0d1bd481bd96 tempest-VolumesActionsTest-348868115 None] Created volume successfully. Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Acquiring lock "cinder-b6d325c6-052e-4cae-a23b-490d1f27ffae-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Lock "cinder-b6d325c6-052e-4cae-a23b-490d1f27ffae-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-0046c055-ecf5-44de-946f-cd37643671a1-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Lock "cinder-0046c055-ecf5-44de-946f-cd37643671a1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Acquiring lock "cinder-quobyte-b6d325c6-052e-4cae-a23b-490d1f27ffae" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-quobyte-0046c055-ecf5-44de-946f-cd37643671a1" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Lock "cinder-quobyte-b6d325c6-052e-4cae-a23b-490d1f27ffae" acquired by "delete_volume" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-0046c055-ecf5-44de-946f-cd37643671a1" acquired by "delete_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dcee7f-f42b-4c82-a900-80b9c64c66b3]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6d325c6-052e-4cae-a23b-490d1f27ffae {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec177bcb-96eb-4773-8848-5815e32d1689]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:37 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6d325c6-052e-4cae-a23b-490d1f27ffae Sep 29 18:47:37 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:37 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1 Sep 29 18:47:37 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:37 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6d325c6-052e-4cae-a23b-490d1f27ffae" returned: 0 in 0.432s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6d325c6-052e-4cae-a23b-490d1f27ffae {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:37 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1" returned: 0 in 0.430s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:37 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6d325c6-052e-4cae-a23b-490d1f27ffae Sep 29 18:47:37 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:37 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1 Sep 29 18:47:37 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Acquiring lock "cinder-557778ea-2135-4a62-b5bd-b088003e62bb-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:37 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6d325c6-052e-4cae-a23b-490d1f27ffae" returned: 0 in 0.348s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Lock "cinder-557778ea-2135-4a62-b5bd-b088003e62bb-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Lock "cinder-quobyte-b6d325c6-052e-4cae-a23b-490d1f27ffae" released by "delete_volume" :: held 0.857s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:37 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Acquiring lock "cinder-quobyte-557778ea-2135-4a62-b5bd-b088003e62bb" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0046c055-ecf5-44de-946f-cd37643671a1" returned: 0 in 0.411s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Lock "cinder-quobyte-557778ea-2135-4a62-b5bd-b088003e62bb" acquired by "delete_volume" :: waited 0.038s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-0046c055-ecf5-44de-946f-cd37643671a1" released by "delete_volume" :: held 0.938s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc17a3f-4929-4fbb-b003-8e9e75b0627c]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-557778ea-2135-4a62-b5bd-b088003e62bb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Created reservations ['83b2605a-91f7-42c6-be93-01b0784f6c8c', '76d8a64b-c399-430a-9929-66d234c323ac', '1855ac98-d2ce-42ef-bc02-bca2fbdc0459', 'c42a6107-d76a-4a0f-8eae-4b2b92947ef2'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:37 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Created reservations ['7d41f092-e9a8-4a7a-9a70-411c191b2c15', '8fa30a9f-c709-4ac6-876b-456e8920d4fa', '35e95c3e-5c94-48ec-8f18-569b410e62fc', '9d0e65da-4017-479b-83e1-d4989268cf40'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:38 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-557778ea-2135-4a62-b5bd-b088003e62bb Sep 29 18:47:38 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:38 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:38 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:38 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:38 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:38 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.308s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:38 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-557778ea-2135-4a62-b5bd-b088003e62bb" returned: 0 in 0.474s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-557778ea-2135-4a62-b5bd-b088003e62bb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:38 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Deleted volume successfully. Sep 29 18:47:38 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-557778ea-2135-4a62-b5bd-b088003e62bb Sep 29 18:47:38 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8ccae869-7ef8-4bf5-af64-0119258b1f90 tempest-ProjectReaderTests-1914606091 None] Lock "cinder-b6d325c6-052e-4cae-a23b-490d1f27ffae-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:38 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.306s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:38 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Deleted volume successfully. Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1c6abb8c-2ca0-4cdd-86f8-e28f0293150e tempest-VolumesGetTest-1497843584 None] Lock "cinder-0046c055-ecf5-44de-946f-cd37643671a1-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:38 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-557778ea-2135-4a62-b5bd-b088003e62bb" returned: 0 in 0.285s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Lock "cinder-quobyte-557778ea-2135-4a62-b5bd-b088003e62bb" released by "delete_volume" :: held 0.825s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Created reservations ['d2c18178-266e-4254-9d93-67ac6d74d955', 'b9d5ea5b-6e4b-485e-bbff-220df0d94dcb', 'ff2682a8-af3d-4586-a32e-bb5ceed5b47e', '2cafa87c-e894-41aa-a66e-d0dfeb84bc7d'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:38 devstack sudo[100467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:38 devstack sudo[100467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:39 devstack sudo[100467]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.287s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:39 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Deleted volume successfully. Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-91a55f87-32a8-4b2a-8caa-0b2083d392f1 tempest-VolumesActionsTest-501401051 None] Lock "cinder-557778ea-2135-4a62-b5bd-b088003e62bb-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-909f9628-bba7-43f9-a4f9-86df2b2df18e-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Lock "cinder-909f9628-bba7-43f9-a4f9-86df2b2df18e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-quobyte-909f9628-bba7-43f9-a4f9-86df2b2df18e" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-909f9628-bba7-43f9-a4f9-86df2b2df18e" acquired by "delete_volume" :: waited 0.046s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Flow 'volume_create_manager' (c98ff0e2-4041-459c-a2ab-1beb9f760b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74385720-7403-4819-9a1b-249c16e3e086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[99115922-c675-4d8c-aa1b-2051bd5de691]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74385720-7403-4819-9a1b-249c16e3e086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-550231115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a2635c-99f0-49ba-9065-2fb6dddb3a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081073a0585649779ac6c5b1662af0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:39Z,use_quota=True,user_id='117052e14ecc4ddda8fdab9a9847cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1710c31d-d1f0-407e-90c7-14d0c82b3dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1710c31d-d1f0-407e-90c7-14d0c82b3dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6b9460-78b1-4b02-9f5a-281617132fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e6b9460-78b1-4b02-9f5a-281617132fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4a2635c-99f0-49ba-9065-2fb6dddb3a4e', 'volume_name': 'volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72b2f48-b400-4a61-825f-f49cc8a6feab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b72b2f48-b400-4a61-825f-f49cc8a6feab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0c027f-ed01-43f5-841d-0b08de9e4125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:39 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Volume c4a2635c-99f0-49ba-9065-2fb6dddb3a4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e', 'volume_size': 1} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-550231115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4a2635c-99f0-49ba-9065-2fb6dddb3a4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081073a0585649779ac6c5b1662af0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:39Z,use_quota=True,user_id='117052e14ecc4ddda8fdab9a9847cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Creating volume c4a2635c-99f0-49ba-9065-2fb6dddb3a4e {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:39 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:39 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e Sep 29 18:47:39 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:39 devstack sudo[100472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e 1073741824 Sep 29 18:47:39 devstack sudo[100472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Flow 'volume_create_manager' (cddf02c8-c93e-4ef4-af6b-2469db2def9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090eb57c-8b9f-45b6-8d82-e76fdfc5d8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (090eb57c-8b9f-45b6-8d82-e76fdfc5d8cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240863162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91741a43-aa59-4422-af45-dd82b41c1619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c4e77f94d94d558c76cad4883bac8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:40Z,use_quota=True,user_id='cd78075270b046a089143a01b505d1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87131f7-23dc-4cab-950f-0e96697c212b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e87131f7-23dc-4cab-950f-0e96697c212b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6dfa88-4443-4484-92c8-f5843e5ef955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f6dfa88-4443-4484-92c8-f5843e5ef955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91741a43-aa59-4422-af45-dd82b41c1619', 'volume_name': 'volume-91741a43-aa59-4422-af45-dd82b41c1619', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f002e111-e5e7-4a5c-9571-d466ff16d999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f002e111-e5e7-4a5c-9571-d466ff16d999) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d2e652-c95c-4590-bf18-380b444b82c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:39 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Volume 91741a43-aa59-4422-af45-dd82b41c1619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91741a43-aa59-4422-af45-dd82b41c1619', 'volume_size': 1} Sep 29 18:47:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:40 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e" returned: 0 in 0.443s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:40 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e Sep 29 18:47:40 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:40 devstack sudo[100472]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e 1073741824" returned: 0 in 0.511s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:40 devstack sudo[100484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e Sep 29 18:47:40 devstack sudo[100484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:40 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-909f9628-bba7-43f9-a4f9-86df2b2df18e" returned: 0 in 0.270s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-909f9628-bba7-43f9-a4f9-86df2b2df18e" released by "delete_volume" :: held 0.843s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Created reservations ['86d31127-ed51-4fc0-92df-fe166fe8f575', 'd099861b-5ff7-4acc-887a-c8781e9837cd', '54b73992-5483-4c1a-bb9a-bf488c4ed9ce', '405b23a6-1a2e-4ed5-89be-dc20709440a5'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:40 devstack sudo[100488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:40 devstack sudo[100488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:40 devstack sudo[100484]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e" returned: 0 in 0.319s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.707s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1240863162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91741a43-aa59-4422-af45-dd82b41c1619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5c4e77f94d94d558c76cad4883bac8f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:40Z,use_quota=True,user_id='cd78075270b046a089143a01b505d1b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Creating volume 91741a43-aa59-4422-af45-dd82b41c1619 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:40 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-91741a43-aa59-4422-af45-dd82b41c1619 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:40 devstack sudo[100490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-91741a43-aa59-4422-af45-dd82b41c1619 1073741824 Sep 29 18:47:40 devstack sudo[100490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd0c027f-ed01-43f5-841d-0b08de9e4125) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a1f575-ee64-425e-9605-6d6c9283a958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:40 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Volume volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e (c4a2635c-99f0-49ba-9065-2fb6dddb3a4e): created successfully Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78a1f575-ee64-425e-9605-6d6c9283a958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Flow 'volume_create_manager' (c98ff0e2-4041-459c-a2ab-1beb9f760b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:40 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-fac9a264-cbe5-457d-9df3-9c193a985afb tempest-VolumesActionsTest-348868115 None] Created volume successfully. Sep 29 18:47:40 devstack sudo[100488]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.363s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:40 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Deleted volume successfully. Sep 29 18:47:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-84922f9d-2e26-46ca-a74f-52b246af1782 tempest-VolumesGetTest-1497843584 None] Lock "cinder-909f9628-bba7-43f9-a4f9-86df2b2df18e-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:41 devstack sudo[100490]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-91741a43-aa59-4422-af45-dd82b41c1619 1073741824" returned: 0 in 0.638s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-91741a43-aa59-4422-af45-dd82b41c1619 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:41 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-91741a43-aa59-4422-af45-dd82b41c1619 Sep 29 18:47:41 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (781b6e1f-e438-43ea-a412-4a26a73839aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd9c7b4-381d-49dc-a48b-6f6bf58f7caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bd9c7b4-381d-49dc-a48b-6f6bf58f7caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-652173779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc875ba-a8bc-4a27-b629-3915d0a4d590,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='24e22c1568584b3394f82865e86769b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:42Z,use_quota=True,user_id='e7a46f6068154174a6d0db44e20e5bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:41 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a3ffb6-2c1a-4f45-b970-4a8e544eae00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24a3ffb6-2c1a-4f45-b970-4a8e544eae00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d78954-95f3-410f-a319-63660ba3f1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.image.glance [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Creating Keystone auth plugin from conf {{(pid=86523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-91741a43-aa59-4422-af45-dd82b41c1619" returned: 0 in 0.364s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7d2e652-c95c-4590-bf18-380b444b82c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91741a43-aa59-4422-af45-dd82b41c1619', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6eb3ed0-3264-4fd5-b4af-760214919348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:41 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Volume volume-91741a43-aa59-4422-af45-dd82b41c1619 (91741a43-aa59-4422-af45-dd82b41c1619): created successfully Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6eb3ed0-3264-4fd5-b4af-760214919348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Flow 'volume_create_manager' (cddf02c8-c93e-4ef4-af6b-2469db2def9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Acquiring lock "cinder-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:41 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f7ba179d-91f9-4128-ba44-e2775bd74ca7 tempest-ProjectReaderTests-1914606091 None] Created volume successfully. Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Lock "cinder-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Acquiring lock "cinder-quobyte-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Lock "cinder-quobyte-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a8a438-6d46-4ef3-af90-05e1c912d16f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:42 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e Sep 29 18:47:42 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d78954-95f3-410f-a319-63660ba3f1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'adc875ba-a8bc-4a27-b629-3915d0a4d590', 'volume_name': 'volume-adc875ba-a8bc-4a27-b629-3915d0a4d590', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cf1fa6-8aa0-42c3-b174-84cefcaf9fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3cf1fa6-8aa0-42c3-b174-84cefcaf9fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2616b13-0c12-4dcc-aa4c-5c8ec93b42bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:42 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Volume adc875ba-a8bc-4a27-b629-3915d0a4d590: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-adc875ba-a8bc-4a27-b629-3915d0a4d590', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Trying to clone adc875ba-a8bc-4a27-b629-3915d0a4d590 from image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]). {{(pid=86523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:47:42 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e" returned: 0 in 0.433s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:42 devstack sudo[100506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e Sep 29 18:47:42 devstack sudo[100506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:47:42 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Image download 20.69 MB at 20.69 MB/s Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8aea1e-cacb-4130-aee2-603e6dbed0f6]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:42 devstack sudo[100506]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e" returned: 0 in 0.299s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Lock "cinder-quobyte-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e" released by "delete_volume" :: held 0.790s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:42 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD Sep 29 18:47:42 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Created reservations ['750f503a-c6ce-4793-84de-e02182303abf', 'a367238f-f410-4f42-81c3-245441531774', '855976f6-2486-42dc-b77d-4a3b78ab227e', 'd61f4d1d-7c23-4f66-864d-13b75cca16b7'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:42 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:42 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:43 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Acquiring lock "cinder-91741a43-aa59-4422-af45-dd82b41c1619-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD" returned: 0 in 0.587s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Temporary image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 is fetched for user e7a46f6068154174a6d0db44e20e5bad. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Lock "cinder-91741a43-aa59-4422-af45-dd82b41c1619-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:43 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.363s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:43 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Deleted volume successfully. Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Acquiring lock "cinder-quobyte-91741a43-aa59-4422-af45-dd82b41c1619" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-cf05533a-8c16-4b4a-ac97-caf4313e0db9 tempest-VolumesActionsTest-501401051 None] Lock "cinder-c4a2635c-99f0-49ba-9065-2fb6dddb3a4e-delete_volume" released by "delete_volume" :: held 1.478s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Lock "cinder-quobyte-91741a43-aa59-4422-af45-dd82b41c1619" acquired by "delete_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[48eb58fc-ba97-4d10-a4d0-02b6654df8ae]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1fb411-2441-407f-b5cc-eb945ea964c6]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-91741a43-aa59-4422-af45-dd82b41c1619 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:43 devstack sudo[100521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-91741a43-aa59-4422-af45-dd82b41c1619 Sep 29 18:47:43 devstack sudo[100521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:43 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD Sep 29 18:47:43 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:43 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD" returned: 0 in 0.463s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-652173779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adc875ba-a8bc-4a27-b629-3915d0a4d590,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='24e22c1568584b3394f82865e86769b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:42Z,use_quota=True,user_id='e7a46f6068154174a6d0db44e20e5bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Creating volume adc875ba-a8bc-4a27-b629-3915d0a4d590 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:43 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:43 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 1073741824 Sep 29 18:47:43 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:43 devstack sudo[100521]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Flow 'volume_create_manager' (7075b554-16b3-4308-82d2-7bd762356d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a001ce-6a0e-42d5-979d-ef1591b23b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-91741a43-aa59-4422-af45-dd82b41c1619" returned: 0 in 0.546s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-91741a43-aa59-4422-af45-dd82b41c1619 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8a001ce-6a0e-42d5-979d-ef1591b23b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1002838547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a478e4f-0139-4661-9301-d37caf11738c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081073a0585649779ac6c5b1662af0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:44Z,use_quota=True,user_id='117052e14ecc4ddda8fdab9a9847cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:43 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-91741a43-aa59-4422-af45-dd82b41c1619 Sep 29 18:47:43 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78531076-228d-47a8-a4c1-f8c365d3095a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78531076-228d-47a8-a4c1-f8c365d3095a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece494d2-febd-4c21-88c4-0a2bd28aadfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece494d2-febd-4c21-88c4-0a2bd28aadfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a478e4f-0139-4661-9301-d37caf11738c', 'volume_name': 'volume-2a478e4f-0139-4661-9301-d37caf11738c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31821023-1658-427a-bebd-66805fcc6ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31821023-1658-427a-bebd-66805fcc6ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069a1f59-01e9-4dbb-a9fa-9cd8f2987620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:43 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Volume 2a478e4f-0139-4661-9301-d37caf11738c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a478e4f-0139-4661-9301-d37caf11738c', 'volume_size': 1} Sep 29 18:47:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:44 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-91741a43-aa59-4422-af45-dd82b41c1619" returned: 0 in 0.281s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Lock "cinder-quobyte-91741a43-aa59-4422-af45-dd82b41c1619" released by "delete_volume" :: held 0.887s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Created reservations ['8751cf56-32c1-4fb6-8fec-bdde953ce669', '59113fb4-757b-4b36-b6d4-f90a976f07e5', '05c002d0-28b4-4fd9-8910-99f9054236d1', 'f80e3c13-17d9-49a4-8db3-d9b28c8a95d8'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:44 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 1073741824" returned: 0 in 0.501s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:44 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 Sep 29 18:47:44 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:44 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:44 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:44 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590" returned: 0 in 0.274s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.680s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1002838547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a478e4f-0139-4661-9301-d37caf11738c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081073a0585649779ac6c5b1662af0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:44Z,use_quota=True,user_id='117052e14ecc4ddda8fdab9a9847cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Creating volume 2a478e4f-0139-4661-9301-d37caf11738c {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:44 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:44 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2a478e4f-0139-4661-9301-d37caf11738c 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.288s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:44 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Deleted volume successfully. Sep 29 18:47:44 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2a478e4f-0139-4661-9301-d37caf11738c 1073741824 Sep 29 18:47:44 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Attempting download of 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 ((None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}])) to volume adc875ba-a8bc-4a27-b629-3915d0a4d590. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8d8678c8-6942-4e83-9bf5-4334e44e25c2 tempest-ProjectReaderTests-1914606091 None] Lock "cinder-91741a43-aa59-4422-af45-dd82b41c1619-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[01273e01-0a58-493c-aff2-8ff96f13981e]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_p6cilaui {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:44 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_p6cilaui Sep 29 18:47:44 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:45 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2a478e4f-0139-4661-9301-d37caf11738c 1073741824" returned: 0 in 0.426s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:45 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_p6cilaui" returned: 0 in 0.350s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_p6cilaui {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2a478e4f-0139-4661-9301-d37caf11738c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:45 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2a478e4f-0139-4661-9301-d37caf11738c Sep 29 18:47:45 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:45 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_p6cilaui Sep 29 18:47:45 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:45 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2a478e4f-0139-4661-9301-d37caf11738c" returned: 0 in 0.270s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (069a1f59-01e9-4dbb-a9fa-9cd8f2987620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a478e4f-0139-4661-9301-d37caf11738c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc9081d-e0ac-49b7-8e94-d8bd13673108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:45 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_p6cilaui" returned: 1 in 0.332s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_p6cilaui' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:47:45 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Volume volume-2a478e4f-0139-4661-9301-d37caf11738c (2a478e4f-0139-4661-9301-d37caf11738c): created successfully Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fc9081d-e0ac-49b7-8e94-d8bd13673108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Flow 'volume_create_manager' (7075b554-16b3-4308-82d2-7bd762356d40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbac1aae-ae2f-4e8c-830b-00cd431d6356]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:45 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-147df64c-2330-4a61-a9ca-8eaff5602e78 tempest-VolumesActionsTest-348868115 None] Created volume successfully. Sep 29 18:47:45 devstack sudo[100561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD Sep 29 18:47:45 devstack sudo[100561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:45 devstack sudo[100561]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD" returned: 0 in 0.372s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 was qcow2, converting to qcow2 {{(pid=86523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:45 devstack sudo[100566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 Sep 29 18:47:45 devstack sudo[100566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Acquiring lock "cinder-2a478e4f-0139-4661-9301-d37caf11738c-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Lock "cinder-2a478e4f-0139-4661-9301-d37caf11738c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Acquiring lock "cinder-quobyte-2a478e4f-0139-4661-9301-d37caf11738c" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Lock "cinder-quobyte-2a478e4f-0139-4661-9301-d37caf11738c" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:46 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1003ace2-a286-4c56-b449-09d756224b32]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2a478e4f-0139-4661-9301-d37caf11738c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:46 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2a478e4f-0139-4661-9301-d37caf11738c Sep 29 18:47:46 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:46 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2a478e4f-0139-4661-9301-d37caf11738c" returned: 0 in 0.460s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2a478e4f-0139-4661-9301-d37caf11738c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:46 devstack sudo[100579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2a478e4f-0139-4661-9301-d37caf11738c Sep 29 18:47:46 devstack sudo[100579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:46 devstack sudo[100579]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2a478e4f-0139-4661-9301-d37caf11738c" returned: 0 in 0.362s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:46 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Lock "cinder-quobyte-2a478e4f-0139-4661-9301-d37caf11738c" released by "delete_volume" :: held 0.883s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:46 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Created reservations ['b8bf69f2-83b8-44c1-b37d-b2265c1dff2d', '033e15d3-9087-4836-9250-f21160cecd52', 'cfd31553-9551-4870-9f31-aae2c2ba64f5', '1da416b2-c6bd-4198-a7e7-8b8b1ad41618'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:47 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:47 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:47 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.331s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:47 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:47 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Deleted volume successfully. Sep 29 18:47:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f372b8b3-ee88-4a0e-9726-758aef016af7 tempest-VolumesActionsTest-501401051 None] Lock "cinder-2a478e4f-0139-4661-9301-d37caf11738c-delete_volume" released by "delete_volume" :: held 1.494s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:47 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Flow 'volume_create_manager' (ed408d8c-b970-4140-a506-63e1f85cd174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73311247-f2b3-4805-8080-ad528e360898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73311247-f2b3-4805-8080-ad528e360898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1129141181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61aa8554-5e78-4cd9-bad5-339703f24398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081073a0585649779ac6c5b1662af0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:48Z,use_quota=True,user_id='117052e14ecc4ddda8fdab9a9847cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8279639a-52fc-4bf3-b97f-9518b85d6ec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8279639a-52fc-4bf3-b97f-9518b85d6ec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d2f599-84a0-42d8-98b7-0df27eedc005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d2f599-84a0-42d8-98b7-0df27eedc005) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61aa8554-5e78-4cd9-bad5-339703f24398', 'volume_name': 'volume-61aa8554-5e78-4cd9-bad5-339703f24398', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9beda2-dfda-486d-ab01-b1c411b3caf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b9beda2-dfda-486d-ab01-b1c411b3caf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc91dd0a-31de-4b1e-a30b-c17bb967ed2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:48 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Volume 61aa8554-5e78-4cd9-bad5-339703f24398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61aa8554-5e78-4cd9-bad5-339703f24398', 'volume_size': 1} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1129141181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61aa8554-5e78-4cd9-bad5-339703f24398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='081073a0585649779ac6c5b1662af0e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:48Z,use_quota=True,user_id='117052e14ecc4ddda8fdab9a9847cd25',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Creating volume 61aa8554-5e78-4cd9-bad5-339703f24398 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:48 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61aa8554-5e78-4cd9-bad5-339703f24398 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:48 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61aa8554-5e78-4cd9-bad5-339703f24398 1073741824 Sep 29 18:47:48 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:48 devstack sudo[100566]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590" returned: 0 in 2.454s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_k8dqmzmtdevstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:47:48 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Converted 112.00 MB image at 45.61 MB/s Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:48 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 1G Sep 29 18:47:48 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:48 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61aa8554-5e78-4cd9-bad5-339703f24398 1073741824" returned: 0 in 0.528s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61aa8554-5e78-4cd9-bad5-339703f24398 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:48 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 1G" returned: 0 in 0.371s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Downloaded image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 ((None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}])) to volume adc875ba-a8bc-4a27-b629-3915d0a4d590 successfully. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Temporary image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 for user e7a46f6068154174a6d0db44e20e5bad is deleted. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Marking volume adc875ba-a8bc-4a27-b629-3915d0a4d590 as bootable. {{(pid=86523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:47:48 devstack sudo[100596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61aa8554-5e78-4cd9-bad5-339703f24398 Sep 29 18:47:48 devstack sudo[100596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Copying metadata from image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 to adc875ba-a8bc-4a27-b629-3915d0a4d590. {{(pid=86523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Creating volume glance metadata for volume adc875ba-a8bc-4a27-b629-3915d0a4d590 backed by image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2616b13-0c12-4dcc-aa4c-5c8ec93b42bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adc875ba-a8bc-4a27-b629-3915d0a4d590', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6d5275-de35-464a-bf4e-62ab1c9ef77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:48 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Volume volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 (adc875ba-a8bc-4a27-b629-3915d0a4d590): created successfully Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f6d5275-de35-464a-bf4e-62ab1c9ef77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (781b6e1f-e438-43ea-a412-4a26a73839aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:48 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3db92a4a-2452-4cd8-b846-65e428f0bcf4 tempest-VolumesGetTest-1497843584 None] Created volume successfully. Sep 29 18:47:48 devstack sudo[100596]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61aa8554-5e78-4cd9-bad5-339703f24398" returned: 0 in 0.289s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] <== create_volume: return (867ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.871s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fc91dd0a-31de-4b1e-a30b-c17bb967ed2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61aa8554-5e78-4cd9-bad5-339703f24398', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b98f89a-5203-43df-9dfa-467b743e862c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:48 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Volume volume-61aa8554-5e78-4cd9-bad5-339703f24398 (61aa8554-5e78-4cd9-bad5-339703f24398): created successfully Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b98f89a-5203-43df-9dfa-467b743e862c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Flow 'volume_create_manager' (ed408d8c-b970-4140-a506-63e1f85cd174) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:49 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-b9169dc9-0c6b-43f5-a390-0727e4dd9c9c tempest-VolumesActionsTest-348868115 None] Created volume successfully. Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (d0fb3331-26dc-4792-b383-38b44047df3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d831fec-c467-435c-aaa1-65483019971c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d831fec-c467-435c-aaa1-65483019971c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-536992155',display_name='tempest-VolumesGetTest-Volume-78095049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fca15a1-37a6-482f-b7d7-ebb6a61ec116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e22c1568584b3394f82865e86769b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:50Z,use_quota=True,user_id='e7a46f6068154174a6d0db44e20e5bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa61fd4d-8ce3-457a-8f71-157ccf43f9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa61fd4d-8ce3-457a-8f71-157ccf43f9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00aa1bdf-4e75-440f-b5ed-ed287fe33771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00aa1bdf-4e75-440f-b5ed-ed287fe33771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3fca15a1-37a6-482f-b7d7-ebb6a61ec116', 'volume_name': 'volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d9c79b-3f79-4383-82a1-b2169752af51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38d9c79b-3f79-4383-82a1-b2169752af51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f633ac41-f414-4d5e-954b-0795056a038a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:49 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Volume 3fca15a1-37a6-482f-b7d7-ebb6a61ec116: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116', 'volume_size': 1} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:49Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-536992155',display_name='tempest-VolumesGetTest-Volume-78095049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3fca15a1-37a6-482f-b7d7-ebb6a61ec116,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24e22c1568584b3394f82865e86769b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:47:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:47:50Z,use_quota=True,user_id='e7a46f6068154174a6d0db44e20e5bad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Creating volume 3fca15a1-37a6-482f-b7d7-ebb6a61ec116 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:49 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:49 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116 1073741824 Sep 29 18:47:49 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:50 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116 1073741824" returned: 0 in 0.600s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:50 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116 Sep 29 18:47:50 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Acquiring lock "cinder-61aa8554-5e78-4cd9-bad5-339703f24398-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Lock "cinder-61aa8554-5e78-4cd9-bad5-339703f24398-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Acquiring lock "cinder-quobyte-61aa8554-5e78-4cd9-bad5-339703f24398" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Lock "cinder-quobyte-61aa8554-5e78-4cd9-bad5-339703f24398" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:50 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116" returned: 0 in 0.359s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] <== create_volume: return (1018ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.021s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f633ac41-f414-4d5e-954b-0795056a038a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ec36c5-9c2c-4387-a1ee-0e42da4e39f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[48567455-ecc1-4c48-8251-a9d9c5f298d1]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61aa8554-5e78-4cd9-bad5-339703f24398 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:50 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Volume volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116 (3fca15a1-37a6-482f-b7d7-ebb6a61ec116): created successfully Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d2ec36c5-9c2c-4387-a1ee-0e42da4e39f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Flow 'volume_create_manager' (d0fb3331-26dc-4792-b383-38b44047df3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:50 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f59d5495-6d3c-45a8-a652-b5ce78b2979d tempest-VolumesGetTest-1497843584 None] Created volume successfully. Sep 29 18:47:51 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61aa8554-5e78-4cd9-bad5-339703f24398 Sep 29 18:47:51 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:51 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61aa8554-5e78-4cd9-bad5-339703f24398" returned: 0 in 0.390s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61aa8554-5e78-4cd9-bad5-339703f24398 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:51 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61aa8554-5e78-4cd9-bad5-339703f24398 Sep 29 18:47:51 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:51 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-61aa8554-5e78-4cd9-bad5-339703f24398" returned: 0 in 0.257s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Lock "cinder-quobyte-61aa8554-5e78-4cd9-bad5-339703f24398" released by "delete_volume" :: held 0.701s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:51 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Created reservations ['dd0e6645-f187-4465-961f-2652991f0a5c', '70b35073-35c8-47d5-8a58-667abd4b22e6', 'bfe4c922-fa49-4e55-9966-6c22fae730bf', '8cad0255-1687-4088-a923-b20c053bd4c6'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:51 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:51 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:52 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.318s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:52 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:52 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Deleted volume successfully. Sep 29 18:47:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-300c001e-3278-4523-9ff0-12952abca068 tempest-VolumesActionsTest-348868115 None] Lock "cinder-61aa8554-5e78-4cd9-bad5-339703f24398-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-3fca15a1-37a6-482f-b7d7-ebb6a61ec116-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Lock "cinder-3fca15a1-37a6-482f-b7d7-ebb6a61ec116-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-quobyte-3fca15a1-37a6-482f-b7d7-ebb6a61ec116" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-3fca15a1-37a6-482f-b7d7-ebb6a61ec116" acquired by "delete_volume" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:52 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5c1d5d7-ec85-4627-8ab5-d6519c2937a4]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:52 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116 Sep 29 18:47:52 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:52 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116" returned: 0 in 0.444s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:52 devstack sudo[100627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116 Sep 29 18:47:52 devstack sudo[100627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:52 devstack sudo[100627]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3fca15a1-37a6-482f-b7d7-ebb6a61ec116" returned: 0 in 0.321s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-3fca15a1-37a6-482f-b7d7-ebb6a61ec116" released by "delete_volume" :: held 0.821s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Created reservations ['1bd50fed-3ddc-4221-988c-0137e6822dde', 'ffb2438e-118a-4dbf-a13a-11118276af41', '6edfead7-28a1-4eba-8fe9-3d7ef29734d6', '505579d2-257a-447c-97dd-586ef3b28558'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:53 devstack sudo[100631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:53 devstack sudo[100631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-adc875ba-a8bc-4a27-b629-3915d0a4d590-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Lock "cinder-adc875ba-a8bc-4a27-b629-3915d0a4d590-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Acquiring lock "cinder-quobyte-adc875ba-a8bc-4a27-b629-3915d0a4d590" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-adc875ba-a8bc-4a27-b629-3915d0a4d590" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:47:53 devstack sudo[100631]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af12411-69e7-4167-9742-72e4a07171cf]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.359s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:53 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Deleted volume successfully. Sep 29 18:47:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-675731f5-1cfd-4865-b4d5-fc50b1c5be3f tempest-VolumesGetTest-1497843584 None] Lock "cinder-3fca15a1-37a6-482f-b7d7-ebb6a61ec116-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:53 devstack sudo[100634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 Sep 29 18:47:53 devstack sudo[100634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:54 devstack sudo[100634]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590" returned: 0 in 0.473s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:54 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590 Sep 29 18:47:54 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:54 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-adc875ba-a8bc-4a27-b629-3915d0a4d590" returned: 0 in 0.272s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Lock "cinder-quobyte-adc875ba-a8bc-4a27-b629-3915d0a4d590" released by "delete_volume" :: held 0.829s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Created reservations ['1b363cd4-d07f-4eae-b8aa-e960fd744c15', 'c54e3a9c-ef61-411c-938d-51d75182b3aa', '1fe6558d-5318-471e-85d3-5eab5c8a8e4a', 'dc51f5cc-a8a6-47cb-ab04-7449dc1f8e76'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:54 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:54 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:54 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.360s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:54 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Deleted volume successfully. Sep 29 18:47:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c5248083-a9aa-4f10-97c5-744405c7f31a tempest-VolumesGetTest-1497843584 None] Lock "cinder-adc875ba-a8bc-4a27-b629-3915d0a4d590-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:47:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:47:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:58 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:47:58 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:47:58 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Sep 29 18:47:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.364s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:47:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:47:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:47:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:47:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Flow 'volume_create_manager' (a0ca85f2-24ef-4bf6-92ad-087885ee4bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ca0a08-dc91-438c-a3a7-f749179e51cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9ca0a08-dc91-438c-a3a7-f749179e51cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1083980387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8256082-0b30-48b5-a4e4-12afba669b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77e94d7b5374c7a93b049188c2caf47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:00Z,use_quota=True,user_id='4127d8dd152d451c807e00dfdd722ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e8fd15-457a-4c3f-9f72-80e3bb9fa59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71e8fd15-457a-4c3f-9f72-80e3bb9fa59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9dd559-16da-466b-90ee-5f8073caf826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc9dd559-16da-466b-90ee-5f8073caf826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8256082-0b30-48b5-a4e4-12afba669b1f', 'volume_name': 'volume-c8256082-0b30-48b5-a4e4-12afba669b1f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49cae79b-986c-4915-8feb-fb4dc082f381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49cae79b-986c-4915-8feb-fb4dc082f381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e84d9af-12fc-4078-85fe-5bf2224ab928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:47:59 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Volume c8256082-0b30-48b5-a4e4-12afba669b1f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8256082-0b30-48b5-a4e4-12afba669b1f', 'volume_size': 1} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1083980387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8256082-0b30-48b5-a4e4-12afba669b1f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e77e94d7b5374c7a93b049188c2caf47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:00Z,use_quota=True,user_id='4127d8dd152d451c807e00dfdd722ccd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Creating volume c8256082-0b30-48b5-a4e4-12afba669b1f {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:47:59 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:47:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:47:59 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f 1073741824 Sep 29 18:47:59 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:00 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f 1073741824" returned: 0 in 0.540s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:00 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f Sep 29 18:48:00 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:00 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f" returned: 0 in 0.290s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:48:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e84d9af-12fc-4078-85fe-5bf2224ab928) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8256082-0b30-48b5-a4e4-12afba669b1f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb8f663-3107-4861-9a5f-60784e951c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:00 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Volume volume-c8256082-0b30-48b5-a4e4-12afba669b1f (c8256082-0b30-48b5-a4e4-12afba669b1f): created successfully Sep 29 18:48:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffb8f663-3107-4861-9a5f-60784e951c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Flow 'volume_create_manager' (a0ca85f2-24ef-4bf6-92ad-087885ee4bf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:00 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-69711577-4168-4870-9f55-89ba71635bc5 tempest-VolumesSnapshotListTestJSON-1972746402 None] Created volume successfully. Sep 29 18:48:02 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=200,cinder:UPDATE=271,cinder:INSERT=76,cinder:DELETE=24 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:48:02 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:DELETE=22,cinder:SELECT=191,cinder:INSERT=75,cinder:UPDATE=278 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:48:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] Creating offline snapshot 10fe3e9b-41a3-435a-b553-cb6c000e8ec3 of volume c8256082-0b30-48b5-a4e4-12afba669b1f {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:48:02 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0edcf59e-f506-490b-9953-9820e1de1bc9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:02 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f Sep 29 18:48:02 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:02 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f" returned: 0 in 0.423s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:02 devstack sudo[100708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 1G Sep 29 18:48:02 devstack sudo[100708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:03 devstack sudo[100708]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 1G" returned: 0 in 0.523s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8256082-0b30-48b5-a4e4-12afba669b1f -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:03 devstack sudo[100714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8256082-0b30-48b5-a4e4-12afba669b1f -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 Sep 29 18:48:03 devstack sudo[100714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:03 devstack sudo[100714]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8256082-0b30-48b5-a4e4-12afba669b1f -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3" returned: 0 in 0.361s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:03 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 is being set with open permissions: ugo+rw Sep 29 18:48:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:03 devstack sudo[100721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 Sep 29 18:48:03 devstack sudo[100721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:03 devstack sudo[100721]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3" returned: 0 in 0.295s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:03 devstack sudo[100724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.info Sep 29 18:48:03 devstack sudo[100724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:04 devstack sudo[100724]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.info" returned: 0 in 0.340s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:04 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.info is being set with open permissions: ugo+rw Sep 29 18:48:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:04 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.info Sep 29 18:48:04 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:04 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.info" returned: 0 in 0.284s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.346s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:04 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1cd66748-804b-4ae7-b8ac-94200bd52106 tempest-VolumesSnapshotListTestJSON-1972746402 None] Create snapshot completed successfully Sep 29 18:48:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] Creating offline snapshot f9170d36-6774-404e-8f28-b3f24f468448 of volume c8256082-0b30-48b5-a4e4-12afba669b1f {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:48:05 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3813a60-a6fe-4773-a5b0-090fed651aaf]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:05 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 Sep 29 18:48:05 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:06 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3" returned: 0 in 0.423s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8256082-0b30-48b5-a4e4-12afba669b1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:48:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:06 devstack sudo[100736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 1G Sep 29 18:48:06 devstack sudo[100736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:06 devstack sudo[100736]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 1G" returned: 0 in 0.600s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:06 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 Sep 29 18:48:06 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:07 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448" returned: 0 in 0.403s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:07 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 is being set with open permissions: ugo+rw Sep 29 18:48:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:07 devstack sudo[100746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 Sep 29 18:48:07 devstack sudo[100746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:07 devstack sudo[100746]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448" returned: 0 in 0.356s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.971s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:07 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-893c4c68-20eb-40b2-87e0-428ce0ac8285 tempest-VolumesSnapshotListTestJSON-1972746402 None] Create snapshot completed successfully Sep 29 18:48:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] Creating offline snapshot d5b406af-a608-41a6-8f89-e9f946c4b2fa of volume c8256082-0b30-48b5-a4e4-12afba669b1f {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:48:07 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d48f7770-e474-45ed-8744-ed40d3d2d3dd]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:08 devstack sudo[100749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 Sep 29 18:48:08 devstack sudo[100749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Flow 'volume_create_manager' (9e215f38-0b40-462b-abe4-39190be6ddb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b09f8a-f145-43ee-9ec2-6c660d4e4845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b09f8a-f145-43ee-9ec2-6c660d4e4845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1505207790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bee5cc1-b30d-4401-ac4b-6394cd486b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342c2c10d06a42c3993ce647e7c42b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:08Z,use_quota=True,user_id='137c5366c84d4b2a90bc6dff74f3c0e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfad59f-f129-4d93-9973-1f93ff3894ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cfad59f-f129-4d93-9973-1f93ff3894ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24580611-1fe8-4ea0-9b45-65b7564ecc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24580611-1fe8-4ea0-9b45-65b7564ecc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bee5cc1-b30d-4401-ac4b-6394cd486b24', 'volume_name': 'volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce131c46-e64a-4627-9497-cbaedd094d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce131c46-e64a-4627-9497-cbaedd094d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449b0564-6267-464e-92c7-83a26f153356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:08 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Volume 3bee5cc1-b30d-4401-ac4b-6394cd486b24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24', 'volume_size': 1} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:08 devstack sudo[100749]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448" returned: 0 in 0.445s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8256082-0b30-48b5-a4e4-12afba669b1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:08 devstack sudo[100755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa 1G Sep 29 18:48:08 devstack sudo[100755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:08 devstack sudo[100755]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa 1G" returned: 0 in 0.509s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:08 devstack sudo[100761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa Sep 29 18:48:08 devstack sudo[100761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:09 devstack sudo[100761]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa" returned: 0 in 0.319s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:09 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa is being set with open permissions: ugo+rw Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:09 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa Sep 29 18:48:09 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:09 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa" returned: 0 in 0.262s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.696s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.192s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1505207790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bee5cc1-b30d-4401-ac4b-6394cd486b24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342c2c10d06a42c3993ce647e7c42b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:08Z,use_quota=True,user_id='137c5366c84d4b2a90bc6dff74f3c0e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Creating volume 3bee5cc1-b30d-4401-ac4b-6394cd486b24 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:48:09 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:48:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:09 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24 1073741824 Sep 29 18:48:09 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:09 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-25f8461a-2be3-476b-a635-ef43a5b5107f tempest-VolumesSnapshotListTestJSON-1972746402 None] Create snapshot completed successfully Sep 29 18:48:10 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24 1073741824" returned: 0 in 0.612s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:10 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24 Sep 29 18:48:10 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:10 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24" returned: 0 in 0.329s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:48:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (449b0564-6267-464e-92c7-83a26f153356) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b608b9-e4e7-48a5-95ee-9714767ec944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:10 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Volume volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24 (3bee5cc1-b30d-4401-ac4b-6394cd486b24): created successfully Sep 29 18:48:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0b608b9-e4e7-48a5-95ee-9714767ec944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Flow 'volume_create_manager' (9e215f38-0b40-462b-abe4-39190be6ddb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:10 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-de8cf336-1101-4d19-ab3c-30d479177395 tempest-VolumesListAdminTestJSON-1318074545 None] Created volume successfully. Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "cinder-d5b406af-a608-41a6-8f89-e9f946c4b2fa-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-d5b406af-a608-41a6-8f89-e9f946c4b2fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "cinder-quobyte-c8256082-0b30-48b5-a4e4-12afba669b1f" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-c8256082-0b30-48b5-a4e4-12afba669b1f" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "cinder-quobyte-d5b406af-a608-41a6-8f89-e9f946c4b2fa" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-d5b406af-a608-41a6-8f89-e9f946c4b2fa" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Deleting offline snapshot d5b406af-a608-41a6-8f89-e9f946c4b2fa of volume c8256082-0b30-48b5-a4e4-12afba669b1f {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] snapshot_file for this snap is: volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e191982b-c8d7-45b7-8105-829d2d3300ef]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:11 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa Sep 29 18:48:11 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:11 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa" returned: 0 in 0.447s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8256082-0b30-48b5-a4e4-12afba669b1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e286736-1a00-4746-b1d7-ff830d7a37d5]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:11 devstack sudo[100784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 Sep 29 18:48:11 devstack sudo[100784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Flow 'volume_create_manager' (6c9570cc-4377-4fc4-a983-45f3bc424e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799d6ea4-2d55-44c9-a705-63964ea58f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (799d6ea4-2d55-44c9-a705-63964ea58f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-959539533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46218f67-8ea4-4e63-bfa0-634f941b030a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342c2c10d06a42c3993ce647e7c42b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:12Z,use_quota=True,user_id='137c5366c84d4b2a90bc6dff74f3c0e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b40ba15-7f10-43b8-85a5-9fb3eb19d034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b40ba15-7f10-43b8-85a5-9fb3eb19d034) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc64b0c-2b31-4a3e-8a35-d0dfa767bc01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4dc64b0c-2b31-4a3e-8a35-d0dfa767bc01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46218f67-8ea4-4e63-bfa0-634f941b030a', 'volume_name': 'volume-46218f67-8ea4-4e63-bfa0-634f941b030a', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3905df2-199a-4c21-b83b-1a65a307e2fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3905df2-199a-4c21-b83b-1a65a307e2fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccb2578-77d8-4ca4-8db0-005acef1153c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:12 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Volume 46218f67-8ea4-4e63-bfa0-634f941b030a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46218f67-8ea4-4e63-bfa0-634f941b030a', 'volume_size': 1} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-959539533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46218f67-8ea4-4e63-bfa0-634f941b030a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342c2c10d06a42c3993ce647e7c42b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:12Z,use_quota=True,user_id='137c5366c84d4b2a90bc6dff74f3c0e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Creating volume 46218f67-8ea4-4e63-bfa0-634f941b030a {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:48:12 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46218f67-8ea4-4e63-bfa0-634f941b030a 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:12 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46218f67-8ea4-4e63-bfa0-634f941b030a 1073741824 Sep 29 18:48:12 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:12 devstack sudo[100784]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448" returned: 0 in 0.509s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8256082-0b30-48b5-a4e4-12afba669b1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:12 devstack sudo[100792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa Sep 29 18:48:12 devstack sudo[100792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:12 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46218f67-8ea4-4e63-bfa0-634f941b030a 1073741824" returned: 0 in 0.535s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46218f67-8ea4-4e63-bfa0-634f941b030a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:12 devstack sudo[100802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46218f67-8ea4-4e63-bfa0-634f941b030a Sep 29 18:48:12 devstack sudo[100802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:12 devstack sudo[100792]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa" returned: 0 in 0.519s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:12 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa Sep 29 18:48:12 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:13 devstack sudo[100802]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46218f67-8ea4-4e63-bfa0-634f941b030a" returned: 0 in 0.274s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] <== create_volume: return (856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ccb2578-77d8-4ca4-8db0-005acef1153c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46218f67-8ea4-4e63-bfa0-634f941b030a', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa51587-cbd1-43a6-ab5a-0e061b45df8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:13 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Volume volume-46218f67-8ea4-4e63-bfa0-634f941b030a (46218f67-8ea4-4e63-bfa0-634f941b030a): created successfully Sep 29 18:48:13 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa51587-cbd1-43a6-ab5a-0e061b45df8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Flow 'volume_create_manager' (6c9570cc-4377-4fc4-a983-45f3bc424e9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.d5b406af-a608-41a6-8f89-e9f946c4b2fa" returned: 0 in 0.289s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-d5b406af-a608-41a6-8f89-e9f946c4b2fa" released by "_delete_snapshot" :: held 1.907s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:13 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e657bdf1-643f-4afe-8a2d-509c213236ba tempest-VolumesListAdminTestJSON-1318074545 None] Created volume successfully. Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-c8256082-0b30-48b5-a4e4-12afba669b1f" released by "delete_snapshot" :: held 1.938s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Created reservations ['fb43801d-5f8f-4899-b385-a376f6d5539d', '86de97d8-8626-4b07-b749-e48415260725', 'ff2c7635-f5a0-45d2-8943-4d5f37f125f9', '46daf7dd-bcfa-4aac-8d42-3e8b5a9af5d7'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:48:13 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Delete snapshot completed successfully. Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d978ec8-5d58-4740-82d5-c5d731da4eb9 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-d5b406af-a608-41a6-8f89-e9f946c4b2fa-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "cinder-f9170d36-6774-404e-8f28-b3f24f468448-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-f9170d36-6774-404e-8f28-b3f24f468448-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "cinder-quobyte-c8256082-0b30-48b5-a4e4-12afba669b1f" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-c8256082-0b30-48b5-a4e4-12afba669b1f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "cinder-quobyte-f9170d36-6774-404e-8f28-b3f24f468448" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-f9170d36-6774-404e-8f28-b3f24f468448" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Deleting offline snapshot f9170d36-6774-404e-8f28-b3f24f468448 of volume c8256082-0b30-48b5-a4e4-12afba669b1f {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] snapshot_file for this snap is: volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[be27ca2f-48ca-4612-b761-6aa32050eb38]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:13 devstack sudo[100809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 Sep 29 18:48:13 devstack sudo[100809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:13 devstack sudo[100809]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448" returned: 0 in 0.385s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8256082-0b30-48b5-a4e4-12afba669b1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e17b63-77be-4762-8573-30852d952d14]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:13 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 Sep 29 18:48:13 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:14 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3" returned: 0 in 0.397s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8256082-0b30-48b5-a4e4-12afba669b1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:14 devstack sudo[100820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 Sep 29 18:48:14 devstack sudo[100820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:14 devstack sudo[100820]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448" returned: 0 in 0.457s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:14 devstack sudo[100825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448 Sep 29 18:48:14 devstack sudo[100825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Flow 'volume_create_manager' (77c1bf09-5537-481f-90a0-ccc1157d6368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ec6a5e-0b2a-4125-b625-521df187690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0ec6a5e-0b2a-4125-b625-521df187690c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1280754847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ddfb6f0-efad-4f5f-b04e-92ff183994ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342c2c10d06a42c3993ce647e7c42b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:15Z,use_quota=True,user_id='137c5366c84d4b2a90bc6dff74f3c0e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b67629-a2a5-4c67-82db-6b992a26a57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b67629-a2a5-4c67-82db-6b992a26a57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580a81fe-6d51-4de4-8157-80d07c1a6357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580a81fe-6d51-4de4-8157-80d07c1a6357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ddfb6f0-efad-4f5f-b04e-92ff183994ba', 'volume_name': 'volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e91633-1210-4842-bccb-3abf5ff3c981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9e91633-1210-4842-bccb-3abf5ff3c981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23553cf-56fe-4ff3-8bcd-8a7d06da890e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:14 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Volume 2ddfb6f0-efad-4f5f-b04e-92ff183994ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba', 'volume_size': 1} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1280754847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ddfb6f0-efad-4f5f-b04e-92ff183994ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='342c2c10d06a42c3993ce647e7c42b82',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:15Z,use_quota=True,user_id='137c5366c84d4b2a90bc6dff74f3c0e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Creating volume 2ddfb6f0-efad-4f5f-b04e-92ff183994ba {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:48:14 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:14 devstack sudo[100828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba 1073741824 Sep 29 18:48:14 devstack sudo[100828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:14 devstack sudo[100825]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.f9170d36-6774-404e-8f28-b3f24f468448" returned: 0 in 0.277s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-f9170d36-6774-404e-8f28-b3f24f468448" released by "_delete_snapshot" :: held 1.633s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-c8256082-0b30-48b5-a4e4-12afba669b1f" released by "delete_snapshot" :: held 1.656s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Created reservations ['f108cf11-ae17-4f70-bd32-fbb565c1c6c9', '973137ad-0400-412b-80cd-6308eb726000', 'e0958ab7-d35c-4043-93b3-1f9906c77a90', '02c73f95-1910-4f5b-97ef-b1629c912868'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:48:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Delete snapshot completed successfully. Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab059201-59dd-42b9-a375-0d42a0730407 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-f9170d36-6774-404e-8f28-b3f24f468448-delete_snapshot" released by "delete_snapshot" :: held 1.814s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:15 devstack sudo[100828]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba 1073741824" returned: 0 in 0.464s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:15 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba Sep 29 18:48:15 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "cinder-10fe3e9b-41a3-435a-b553-cb6c000e8ec3-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-10fe3e9b-41a3-435a-b553-cb6c000e8ec3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "cinder-quobyte-c8256082-0b30-48b5-a4e4-12afba669b1f" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-c8256082-0b30-48b5-a4e4-12afba669b1f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "cinder-quobyte-10fe3e9b-41a3-435a-b553-cb6c000e8ec3" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-10fe3e9b-41a3-435a-b553-cb6c000e8ec3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Deleting offline snapshot 10fe3e9b-41a3-435a-b553-cb6c000e8ec3 of volume c8256082-0b30-48b5-a4e4-12afba669b1f {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] snapshot_file for this snap is: volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7f4a9e-6cad-4317-be58-4b7ac6a91c75]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:15 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba" returned: 0 in 0.302s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] <== create_volume: return (811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:15 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d23553cf-56fe-4ff3-8bcd-8a7d06da890e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:15 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095fa635-af07-484b-987c-fc19b8fdbc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:15 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Volume volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba (2ddfb6f0-efad-4f5f-b04e-92ff183994ba): created successfully Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095fa635-af07-484b-987c-fc19b8fdbc00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Flow 'volume_create_manager' (77c1bf09-5537-481f-90a0-ccc1157d6368) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7a440c0f-dc2a-4584-90f4-644ce5638b06 tempest-VolumesListAdminTestJSON-1318074545 None] Created volume successfully. Sep 29 18:48:16 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3" returned: 0 in 0.452s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8256082-0b30-48b5-a4e4-12afba669b1f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:48:16 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[474da6c8-33ef-470b-b083-40fceaa58571]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:16 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f Sep 29 18:48:16 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:16 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f" returned: 0 in 0.406s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:16 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 Sep 29 18:48:16 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:16 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3" returned: 0 in 0.410s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:16 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3 Sep 29 18:48:16 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:17 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f.10fe3e9b-41a3-435a-b553-cb6c000e8ec3" returned: 0 in 0.303s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-10fe3e9b-41a3-435a-b553-cb6c000e8ec3" released by "_delete_snapshot" :: held 1.721s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-c8256082-0b30-48b5-a4e4-12afba669b1f" released by "delete_snapshot" :: held 1.752s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Created reservations ['6f3093af-2598-449d-be86-72e405afde6b', '94276727-c8db-4081-a441-1b410dcaf7e4', '3b9c7ae4-b2dc-4380-9c71-82f2efa01d2b', '5e09753c-e291-4102-bb86-4bce10e1e591'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:48:17 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Delete snapshot completed successfully. Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1fb55bbb-4d0a-48b3-aa33-bc3c196f5456 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-10fe3e9b-41a3-435a-b553-cb6c000e8ec3-delete_snapshot" released by "delete_snapshot" :: held 1.943s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "cinder-c8256082-0b30-48b5-a4e4-12afba669b1f-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-c8256082-0b30-48b5-a4e4-12afba669b1f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Flow 'volume_create_manager' (b958dc1b-ac99-4fef-baa0-68f7366d5468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a47883-7867-407c-969d-8485947127ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "cinder-quobyte-c8256082-0b30-48b5-a4e4-12afba669b1f" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a47883-7867-407c-969d-8485947127ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2969539d-3206-40e4-a989-6c6ee67db334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b1cb6cdd3b4b1a82143cbd577c8e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:18Z,use_quota=True,user_id='51a0635525b443bd8bffbb3fc1c29e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef41b6c-1352-49fb-8190-ae537bcb97d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ef41b6c-1352-49fb-8190-ae537bcb97d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b81191-8a2d-4160-9b2d-40ab40b9dab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68b81191-8a2d-4160-9b2d-40ab40b9dab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2969539d-3206-40e4-a989-6c6ee67db334', 'volume_name': 'volume-2969539d-3206-40e4-a989-6c6ee67db334', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65e077c-dc20-49d3-868e-565ee022d192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65e077c-dc20-49d3-868e-565ee022d192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c06275c-3bc2-43ed-906b-9babbd04bb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:18 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Volume 2969539d-3206-40e4-a989-6c6ee67db334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2969539d-3206-40e4-a989-6c6ee67db334', 'volume_size': 1} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:17Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2969539d-3206-40e4-a989-6c6ee67db334,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60b1cb6cdd3b4b1a82143cbd577c8e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:18Z,use_quota=True,user_id='51a0635525b443bd8bffbb3fc1c29e31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Creating volume 2969539d-3206-40e4-a989-6c6ee67db334 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:48:18 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2969539d-3206-40e4-a989-6c6ee67db334 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-c8256082-0b30-48b5-a4e4-12afba669b1f" acquired by "delete_volume" :: waited 0.082s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:18 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2969539d-3206-40e4-a989-6c6ee67db334 1073741824 Sep 29 18:48:18 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7be53f-25ec-4088-8203-07631f0bcbb9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:18 devstack sudo[100856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f Sep 29 18:48:18 devstack sudo[100856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:18 devstack sudo[100856]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f" returned: 0 in 0.485s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:18 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f Sep 29 18:48:18 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:18 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2969539d-3206-40e4-a989-6c6ee67db334 1073741824" returned: 0 in 0.631s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2969539d-3206-40e4-a989-6c6ee67db334 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:18 devstack sudo[100867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2969539d-3206-40e4-a989-6c6ee67db334 Sep 29 18:48:18 devstack sudo[100867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:18 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c8256082-0b30-48b5-a4e4-12afba669b1f" returned: 0 in 0.352s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-quobyte-c8256082-0b30-48b5-a4e4-12afba669b1f" released by "delete_volume" :: held 0.940s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:19 devstack sudo[100867]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2969539d-3206-40e4-a989-6c6ee67db334" returned: 0 in 0.331s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c06275c-3bc2-43ed-906b-9babbd04bb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2969539d-3206-40e4-a989-6c6ee67db334', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00383542-2078-484f-b294-f349cb6b442a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Created reservations ['7459cf7d-c799-427a-97e1-facc85066c04', 'e0bd43cb-5c84-4923-9fb4-26ecc0fb7e35', '8d5d2672-d7cc-4739-83e4-9aa1c8e54e7f', '897d2c25-6411-47ef-bca1-bc9a6b80ce2d'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:48:19 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Volume volume-2969539d-3206-40e4-a989-6c6ee67db334 (2969539d-3206-40e4-a989-6c6ee67db334): created successfully Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00383542-2078-484f-b294-f349cb6b442a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Flow 'volume_create_manager' (b958dc1b-ac99-4fef-baa0-68f7366d5468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:19 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-88ad4bb0-c130-49a5-b809-01a949037b05 tempest-VolumesListAdminTestJSON-1375397705 None] Created volume successfully. Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:19 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:48:19 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:19 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.291s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:48:19 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Deleted volume successfully. Sep 29 18:48:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-221f1795-2140-4094-8f69-81de016c2f44 tempest-VolumesSnapshotListTestJSON-1972746402 None] Lock "cinder-c8256082-0b30-48b5-a4e4-12afba669b1f-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Acquiring lock "cinder-2969539d-3206-40e4-a989-6c6ee67db334-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Lock "cinder-2969539d-3206-40e4-a989-6c6ee67db334-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Acquiring lock "cinder-quobyte-2969539d-3206-40e4-a989-6c6ee67db334" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Lock "cinder-quobyte-2969539d-3206-40e4-a989-6c6ee67db334" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0596f1d-5d18-46b6-bc1e-e089958436a7]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2969539d-3206-40e4-a989-6c6ee67db334 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "cinder-2ddfb6f0-efad-4f5f-b04e-92ff183994ba-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "cinder-2ddfb6f0-efad-4f5f-b04e-92ff183994ba-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "cinder-quobyte-2ddfb6f0-efad-4f5f-b04e-92ff183994ba" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "cinder-quobyte-2ddfb6f0-efad-4f5f-b04e-92ff183994ba" acquired by "delete_volume" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa99a203-8546-4817-a925-22cc7455eb20]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:20 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2969539d-3206-40e4-a989-6c6ee67db334 Sep 29 18:48:20 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:20 devstack sudo[100876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba Sep 29 18:48:20 devstack sudo[100876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:20 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2969539d-3206-40e4-a989-6c6ee67db334" returned: 0 in 0.679s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2969539d-3206-40e4-a989-6c6ee67db334 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:20 devstack sudo[100876]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba" returned: 0 in 0.513s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:20 devstack sudo[100886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2969539d-3206-40e4-a989-6c6ee67db334 Sep 29 18:48:20 devstack sudo[100886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:20 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba Sep 29 18:48:20 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:21 devstack sudo[100886]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2969539d-3206-40e4-a989-6c6ee67db334" returned: 0 in 0.353s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Lock "cinder-quobyte-2969539d-3206-40e4-a989-6c6ee67db334" released by "delete_volume" :: held 1.097s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:21 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2ddfb6f0-efad-4f5f-b04e-92ff183994ba" returned: 0 in 0.351s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "cinder-quobyte-2ddfb6f0-efad-4f5f-b04e-92ff183994ba" released by "delete_volume" :: held 0.944s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Created reservations ['594b6a33-8642-4312-8d1d-3e50534450ba', '67a9ec7b-8292-4f6d-98ba-e4dd15eea325', '9732c0b4-d5cc-4419-af43-87549057b401', 'bda76669-73b8-4c97-8bcd-e078d2f2e98e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Created reservations ['3ff01231-3750-4a9f-8509-fb5ddb0f906a', '0d065346-18fb-42f5-b672-6657edabfb37', '8dbbe27b-89d8-48b8-98d4-5569794f4ee3', '2257b912-8e77-4d2d-b483-174d24769201'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:21 devstack sudo[100892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:48:21 devstack sudo[100892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:21 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:48:21 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:21 devstack sudo[100892]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.378s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:21 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:48:21 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Deleted volume successfully. Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-58e29c26-1366-4d02-a213-d4e9810cc17e tempest-VolumesListAdminTestJSON-1375397705 None] Lock "cinder-2969539d-3206-40e4-a989-6c6ee67db334-delete_volume" released by "delete_volume" :: held 1.928s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:22 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.403s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:48:22 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Deleted volume successfully. Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d141ad03-12aa-4030-99f3-7425c4b5ff41 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "cinder-2ddfb6f0-efad-4f5f-b04e-92ff183994ba-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "cinder-46218f67-8ea4-4e63-bfa0-634f941b030a-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "cinder-46218f67-8ea4-4e63-bfa0-634f941b030a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "cinder-quobyte-46218f67-8ea4-4e63-bfa0-634f941b030a" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "cinder-quobyte-46218f67-8ea4-4e63-bfa0-634f941b030a" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dddeabb-a4af-4fa3-bf53-e607b2dc33fa]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46218f67-8ea4-4e63-bfa0-634f941b030a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Flow 'volume_create_manager' (af8bcb0a-9fc5-481a-8d98-0f0e9530a3c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fcf32b-ef59-4ccd-baf7-04afcfcd5004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4fcf32b-ef59-4ccd-baf7-04afcfcd5004) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-20478026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd329d9-cda5-46be-b301-7619f14381d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a892450824b74c0d8bdb5aebe6a77d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:23Z,use_quota=True,user_id='35541a92f8104b85a60035702dbff3b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513104a6-7ccb-4a5f-ad84-c525b380bfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:22 devstack sudo[100898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46218f67-8ea4-4e63-bfa0-634f941b030a Sep 29 18:48:22 devstack sudo[100898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513104a6-7ccb-4a5f-ad84-c525b380bfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae61ac4-f5eb-40da-bf6b-991f833a8cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ae61ac4-f5eb-40da-bf6b-991f833a8cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbd329d9-cda5-46be-b301-7619f14381d6', 'volume_name': 'volume-bbd329d9-cda5-46be-b301-7619f14381d6', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e53362-d3a8-49dd-8b94-5cdf88fc8dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e53362-d3a8-49dd-8b94-5cdf88fc8dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741a3c97-16c4-494b-812d-16861b913760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:22 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Volume bbd329d9-cda5-46be-b301-7619f14381d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbd329d9-cda5-46be-b301-7619f14381d6', 'volume_size': 1} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-20478026',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbd329d9-cda5-46be-b301-7619f14381d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a892450824b74c0d8bdb5aebe6a77d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:23Z,use_quota=True,user_id='35541a92f8104b85a60035702dbff3b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Creating volume bbd329d9-cda5-46be-b301-7619f14381d6 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:48:22 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:48:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:22 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 1073741824 Sep 29 18:48:22 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:23 devstack sudo[100898]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46218f67-8ea4-4e63-bfa0-634f941b030a" returned: 0 in 0.404s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46218f67-8ea4-4e63-bfa0-634f941b030a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:23 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46218f67-8ea4-4e63-bfa0-634f941b030a Sep 29 18:48:23 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:23 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 1073741824" returned: 0 in 0.509s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:23 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46218f67-8ea4-4e63-bfa0-634f941b030a" returned: 0 in 0.315s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:23 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "cinder-quobyte-46218f67-8ea4-4e63-bfa0-634f941b030a" released by "delete_volume" :: held 0.777s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:23 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Created reservations ['15e26933-23b8-4b52-a766-62022605c25a', '9ecd7a52-daa0-4d9c-9fbf-4af6168ae706', 'abcfc74f-9b9a-402d-a26d-3fa6c1245626', 'ee6ceee8-4d9a-40e6-9278-be8df654151c'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:23 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:48:23 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:23 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6" returned: 0 in 0.280s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (741a3c97-16c4-494b-812d-16861b913760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbd329d9-cda5-46be-b301-7619f14381d6', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bc8ee6-f9fc-47cf-af34-a881b7d7edd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:23 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Volume volume-bbd329d9-cda5-46be-b301-7619f14381d6 (bbd329d9-cda5-46be-b301-7619f14381d6): created successfully Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57bc8ee6-f9fc-47cf-af34-a881b7d7edd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Flow 'volume_create_manager' (af8bcb0a-9fc5-481a-8d98-0f0e9530a3c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:23 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-467f6399-03e5-48dd-b961-7c34455ad5f9 tempest-SnapshotDependencyTests-2111002210 None] Created volume successfully. Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "cinder-3bee5cc1-b30d-4401-ac4b-6394cd486b24-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:23 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "cinder-3bee5cc1-b30d-4401-ac4b-6394cd486b24-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.302s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:23 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:48:23 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Deleted volume successfully. Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "cinder-quobyte-3bee5cc1-b30d-4401-ac4b-6394cd486b24" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4abe54f2-4cf9-4fd5-b925-7aee37f64942 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "cinder-46218f67-8ea4-4e63-bfa0-634f941b030a-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "cinder-quobyte-3bee5cc1-b30d-4401-ac4b-6394cd486b24" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb2b02c-3c5c-44eb-a47c-b02021646e57]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:24 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24 Sep 29 18:48:24 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:24 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24" returned: 0 in 0.440s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:24 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24 Sep 29 18:48:24 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:24 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3bee5cc1-b30d-4401-ac4b-6394cd486b24" returned: 0 in 0.310s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "cinder-quobyte-3bee5cc1-b30d-4401-ac4b-6394cd486b24" released by "delete_volume" :: held 0.799s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Created reservations ['473a5fb3-458a-4fd3-a7cd-11d6d11a6b8d', '45a38a4d-edde-4e9a-9724-8b746c5a6649', 'fac348c8-4d45-46d2-aaf5-b6dab2e4576d', '71032723-8121-4cf9-89a3-e9580ec9b9cd'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:25 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:48:25 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] Creating offline snapshot 93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 of volume bbd329d9-cda5-46be-b301-7619f14381d6 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:48:25 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d030edf0-c2ce-4658-8658-c2a2056c86d4]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:25 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.376s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:25 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:48:25 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Deleted volume successfully. Sep 29 18:48:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2cd9c73c-7bdc-4787-b8a2-b4784577e784 tempest-VolumesListAdminTestJSON-1318074545 None] Lock "cinder-3bee5cc1-b30d-4401-ac4b-6394cd486b24-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:25 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 Sep 29 18:48:25 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:25 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6" returned: 0 in 0.456s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:25 devstack sudo[100936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 1G Sep 29 18:48:25 devstack sudo[100936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:26 devstack sudo[100936]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 1G" returned: 0 in 0.495s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd329d9-cda5-46be-b301-7619f14381d6 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:26 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd329d9-cda5-46be-b301-7619f14381d6 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 Sep 29 18:48:26 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:26 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbd329d9-cda5-46be-b301-7619f14381d6 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1" returned: 0 in 0.375s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:26 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 is being set with open permissions: ugo+rw Sep 29 18:48:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:26 devstack sudo[100948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 Sep 29 18:48:26 devstack sudo[100948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:26 devstack sudo[100948]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1" returned: 0 in 0.298s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:27 devstack sudo[100951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.info Sep 29 18:48:27 devstack sudo[100951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:27 devstack sudo[100951]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.info" returned: 0 in 0.301s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:27 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.info is being set with open permissions: ugo+rw Sep 29 18:48:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:27 devstack sudo[100954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.info Sep 29 18:48:27 devstack sudo[100954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:27 devstack sudo[100954]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.info" returned: 0 in 0.295s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.361s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3c9c07bf-eafe-4a54-b6bc-904a1216f972 tempest-SnapshotDependencyTests-2111002210 None] Create snapshot completed successfully Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Flow 'volume_create_manager' (afb52443-62e9-477d-ab8d-437e8ff9acc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137d0a2f-08a8-4345-b0cf-c921e42c7572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (137d0a2f-08a8-4345-b0cf-c921e42c7572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:29Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac498f6-ef1a-4376-b944-6dd92328a169,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a892450824b74c0d8bdb5aebe6a77d3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:29Z,use_quota=True,user_id='35541a92f8104b85a60035702dbff3b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e4298b-3d51-4a0f-956c-fee4c79851eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e4298b-3d51-4a0f-956c-fee4c79851eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0902c4e-ef48-4baf-9736-75b0914b615c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0902c4e-ef48-4baf-9736-75b0914b615c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9ac498f6-ef1a-4376-b944-6dd92328a169', 'volume_name': 'volume-9ac498f6-ef1a-4376-b944-6dd92328a169', 'volume_size': 1, 'snapshot_id': '93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8312bc0d-5e2b-466a-a4cd-a63661731218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8312bc0d-5e2b-466a-a4cd-a63661731218) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69162f58-f98e-4648-86d1-a1d458527e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:29 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Volume 9ac498f6-ef1a-4376-b944-6dd92328a169: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9ac498f6-ef1a-4376-b944-6dd92328a169', 'volume_size': 1, 'snapshot_id': '93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1'} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "cinder-quobyte-93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1-9ac498f6-ef1a-4376-b944-6dd92328a169" by "_create_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-quobyte-93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1-9ac498f6-ef1a-4376-b944-6dd92328a169" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Creating volume 9ac498f6-ef1a-4376-b944-6dd92328a169 from snapshot 93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 {{(pid=86523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "cinder-quobyte-9ac498f6-ef1a-4376-b944-6dd92328a169" by "_copy_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-quobyte-9ac498f6-ef1a-4376-b944-6dd92328a169" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] snapshot: 93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1, volume: 9ac498f6-ef1a-4376-b944-6dd92328a169, {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1f0a003-ff2a-48d1-bab2-902764cfea2c]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:29 devstack sudo[100957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 Sep 29 18:48:29 devstack sudo[100957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:29 devstack sudo[100957]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1" returned: 0 in 0.524s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd329d9-cda5-46be-b301-7619f14381d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[934769b1-0697-4d53-bbdc-332fcb3e9f7a]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:29 devstack sudo[100962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 Sep 29 18:48:29 devstack sudo[100962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:30 devstack sudo[100962]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6" returned: 0 in 0.449s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:48:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Creating direct copy from snapshot {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:48:30 devstack cinder-volume[86523]: DEBUG cinder.utils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Path /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169 not found in is_blk_device check {{(pid=86523) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:48:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:30 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169 Sep 29 18:48:30 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:38 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169" returned: 0 in 8.738s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:38 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6, size 1024.00 MB, duration 8.74 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:48:38 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Converted 1024.00 MB image at 117.17 MB/s Sep 29 18:48:38 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169 is being set with open permissions: ugo+rw Sep 29 18:48:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:39 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=59,cinder:INSERT=21,cinder:UPDATE=77,cinder:DELETE=8 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:48:39 devstack sudo[100985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169 Sep 29 18:48:39 devstack sudo[100985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:39 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=67,cinder:UPDATE=76,cinder:DELETE=6,cinder:INSERT=18 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:48:39 devstack sudo[100985]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169" returned: 0 in 0.288s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-quobyte-9ac498f6-ef1a-4376-b944-6dd92328a169" released by "_copy_volume_from_snapshot" :: held 10.101s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-quobyte-93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1-9ac498f6-ef1a-4376-b944-6dd92328a169" released by "_create_volume_from_snapshot" :: held 10.182s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.201s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69162f58-f98e-4648-86d1-a1d458527e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac498f6-ef1a-4376-b944-6dd92328a169', 'volume_size': 1, 'snapshot_id': '93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd06bd0-532d-4de1-b9bb-2d7574e2075a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:39 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Volume volume-9ac498f6-ef1a-4376-b944-6dd92328a169 (9ac498f6-ef1a-4376-b944-6dd92328a169): created successfully Sep 29 18:48:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd06bd0-532d-4de1-b9bb-2d7574e2075a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Flow 'volume_create_manager' (afb52443-62e9-477d-ab8d-437e8ff9acc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:39 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a0dc691f-4cb6-4bab-8355-65762dcc418e tempest-SnapshotDependencyTests-2111002210 None] Created volume successfully. Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "cinder-93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "cinder-quobyte-bbd329d9-cda5-46be-b301-7619f14381d6" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-quobyte-bbd329d9-cda5-46be-b301-7619f14381d6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "cinder-quobyte-93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-quobyte-93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Deleting offline snapshot 93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 of volume bbd329d9-cda5-46be-b301-7619f14381d6 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] snapshot_file for this snap is: volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b99ccc6-062b-4293-9320-d2fcb4d84045]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:40 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 Sep 29 18:48:40 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:40 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1" returned: 0 in 0.476s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbd329d9-cda5-46be-b301-7619f14381d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc91156-d060-44d3-abdd-b6add19887c3]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:41 devstack sudo[100993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 Sep 29 18:48:41 devstack sudo[100993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:41 devstack sudo[100993]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6" returned: 0 in 0.612s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:41 devstack sudo[100999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 Sep 29 18:48:41 devstack sudo[100999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:42 devstack sudo[100999]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1" returned: 0 in 0.403s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:42 devstack sudo[101005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1 Sep 29 18:48:42 devstack sudo[101005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:42 devstack sudo[101005]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6.93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1" returned: 0 in 0.267s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-quobyte-93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1" released by "_delete_snapshot" :: held 1.910s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-quobyte-bbd329d9-cda5-46be-b301-7619f14381d6" released by "delete_snapshot" :: held 1.933s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:42 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Created reservations ['c539f0ca-e4f0-4f85-996e-6b9a927258a2', 'd0fea4c4-b29f-4ecb-bf84-b1beca3d1d2b', 'adf3ddcf-0921-4e48-a9cd-98464a751401', '4d568ec2-bcef-4b11-8501-03bb9f9f7faf'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:48:42 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Delete snapshot completed successfully. Sep 29 18:48:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0648abd5-bc26-458a-8d82-45319ec8fbbd tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-93560ccd-48b4-4e3a-bdc9-2f4ab7c404f1-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "cinder-bbd329d9-cda5-46be-b301-7619f14381d6-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-bbd329d9-cda5-46be-b301-7619f14381d6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "cinder-quobyte-bbd329d9-cda5-46be-b301-7619f14381d6" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-quobyte-bbd329d9-cda5-46be-b301-7619f14381d6" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:42 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[289bfa6a-5e05-42cf-b427-cc64152c30e5]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:42 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 Sep 29 18:48:42 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:43 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6" returned: 0 in 0.462s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:43 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6 Sep 29 18:48:43 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:43 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bbd329d9-cda5-46be-b301-7619f14381d6" returned: 0 in 0.275s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-quobyte-bbd329d9-cda5-46be-b301-7619f14381d6" released by "delete_volume" :: held 0.829s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Created reservations ['68548900-93cd-472b-9309-2a58a02f3a89', '45ca08f9-2433-4325-a4fe-4e0edecb7779', '7024cbc4-1b37-4eaf-b479-dbc40e3b7f22', '88044bcf-4f24-4a02-9cf1-acb543d1f047'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:43 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:48:43 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "cinder-9ac498f6-ef1a-4376-b944-6dd92328a169-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-9ac498f6-ef1a-4376-b944-6dd92328a169-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "cinder-quobyte-9ac498f6-ef1a-4376-b944-6dd92328a169" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-quobyte-9ac498f6-ef1a-4376-b944-6dd92328a169" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbc8189-9f58-4271-af40-5085c63000a9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:44 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.378s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Flow 'volume_create_manager' (078b1a0e-75db-447e-a8f7-bb238e05789f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:44 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169 Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d78ca51-83c2-4bb3-973f-55f514928909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:44 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:44 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Deleted volume successfully. Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d78ca51-83c2-4bb3-973f-55f514928909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-160681473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c869f4-a76a-45ce-9cf7-93d7e106719d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8048ddebe0465ca9b2549191880835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:44Z,use_quota=True,user_id='2475c55ed06447c9a3d4b2faf3c678b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c09be90-1d20-4e02-9f2a-2f5a8cadfa6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c09be90-1d20-4e02-9f2a-2f5a8cadfa6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da70abe-e856-4fae-9a10-69135c5c3594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3da70abe-e856-4fae-9a10-69135c5c3594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8c869f4-a76a-45ce-9cf7-93d7e106719d', 'volume_name': 'volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e2538b-614c-4af5-b335-2a15b5e60ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e2538b-614c-4af5-b335-2a15b5e60ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4969c3a0-5cdd-4b1e-a7de-d6222f9b3a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:44 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Volume d8c869f4-a76a-45ce-9cf7-93d7e106719d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d', 'volume_size': 1} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-160681473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8c869f4-a76a-45ce-9cf7-93d7e106719d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8048ddebe0465ca9b2549191880835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:44Z,use_quota=True,user_id='2475c55ed06447c9a3d4b2faf3c678b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Creating volume d8c869f4-a76a-45ce-9cf7-93d7e106719d {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:48:44 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-cf6bb6c1-5e61-4f43-ad8d-c5f945da54c5 tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-bbd329d9-cda5-46be-b301-7619f14381d6-delete_volume" released by "delete_volume" :: held 1.596s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:44 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d 1073741824 Sep 29 18:48:44 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:44 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169" returned: 0 in 0.542s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:44 devstack sudo[101027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169 Sep 29 18:48:44 devstack sudo[101027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:44 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:44 devstack sudo[101027]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d 1073741824" returned: 0 in 0.652s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9ac498f6-ef1a-4376-b944-6dd92328a169" returned: 0 in 0.333s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-quobyte-9ac498f6-ef1a-4376-b944-6dd92328a169" released by "delete_volume" :: held 0.937s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:44 devstack sudo[101034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d Sep 29 18:48:44 devstack sudo[101034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:44 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Created reservations ['92daddb4-e6d3-4d7c-b963-8c5e661fae43', 'a033fb7a-d5c7-425b-977c-f72213a7bd5f', '4ac42ca7-3968-4d3b-91dd-ad54f890931c', '50fc4a57-5280-4779-825d-1016dc9aa7b2'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:45 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:48:45 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:45 devstack sudo[101034]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d" returned: 0 in 0.328s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4969c3a0-5cdd-4b1e-a7de-d6222f9b3a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f54f19-6fe7-4153-b6a7-3f3dd6b170ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:45 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Volume volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d (d8c869f4-a76a-45ce-9cf7-93d7e106719d): created successfully Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76f54f19-6fe7-4153-b6a7-3f3dd6b170ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Flow 'volume_create_manager' (078b1a0e-75db-447e-a8f7-bb238e05789f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:45 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1b074f0b-9551-42b6-ae58-b1cb30a17bb7 tempest-VolumesTransfersV357Test-41075449 None] Created volume successfully. Sep 29 18:48:45 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.273s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:48:45 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Deleted volume successfully. Sep 29 18:48:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-932c95ef-a147-4fdf-a9b3-adb0ec060c4b tempest-SnapshotDependencyTests-2111002210 None] Lock "cinder-9ac498f6-ef1a-4376-b944-6dd92328a169-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:46 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-71afac42-30ce-48d2-84c8-b557caca7080 tempest-VolumesTransfersV357Test-1413923188 None] Transfer volume completed successfully. Sep 29 18:48:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Acquiring lock "cinder-d8c869f4-a76a-45ce-9cf7-93d7e106719d-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Lock "cinder-d8c869f4-a76a-45ce-9cf7-93d7e106719d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Acquiring lock "cinder-quobyte-d8c869f4-a76a-45ce-9cf7-93d7e106719d" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Lock "cinder-quobyte-d8c869f4-a76a-45ce-9cf7-93d7e106719d" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:47 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef44c5b-66ed-4569-acc8-4a5eec7fbf7f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:47 devstack sudo[101040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d Sep 29 18:48:47 devstack sudo[101040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:48 devstack sudo[101040]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d" returned: 0 in 0.425s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:48 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d Sep 29 18:48:48 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:48 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d8c869f4-a76a-45ce-9cf7-93d7e106719d" returned: 0 in 0.267s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Lock "cinder-quobyte-d8c869f4-a76a-45ce-9cf7-93d7e106719d" released by "delete_volume" :: held 0.757s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:48 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Created reservations ['42957e7a-a5f5-4ef1-b960-9c1016ab6a9d', '873e0546-77c5-4d4e-a09a-00a09a516ca3', 'f2e19734-9602-4bf6-a62c-27256c99e1cc', 'e1c5e3b6-a89a-44fe-b13e-ca6884ac976d'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:48:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:48 devstack sudo[101050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:48:48 devstack sudo[101050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:48 devstack sudo[101050]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.323s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:48 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:48:49 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Deleted volume successfully. Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-20634cf3-3c3e-400f-a812-7b2548ed6c5c tempest-VolumesTransfersV357Test-413327060 None] Lock "cinder-d8c869f4-a76a-45ce-9cf7-93d7e106719d-delete_volume" released by "delete_volume" :: held 1.352s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Flow 'volume_create_manager' (8e410d36-f9f3-4958-a096-ec70e3b5fbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196274bc-4166-4368-bd98-f1c1d5f20dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (196274bc-4166-4368-bd98-f1c1d5f20dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1646708376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cccc5c6-a29d-4e49-b32f-1de21877a16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8048ddebe0465ca9b2549191880835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:49Z,use_quota=True,user_id='2475c55ed06447c9a3d4b2faf3c678b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444ef947-03af-4d2d-8d9a-fd5ee8058995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (444ef947-03af-4d2d-8d9a-fd5ee8058995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7f6d26-54c4-462c-ba1b-f8dfd532f556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c7f6d26-54c4-462c-ba1b-f8dfd532f556) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cccc5c6-a29d-4e49-b32f-1de21877a16f', 'volume_name': 'volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4081dcb6-a391-4c7b-ba6c-90bcee5c5bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4081dcb6-a391-4c7b-ba6c-90bcee5c5bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9da439e-35c4-427e-9a71-8f433972c14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:49 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Volume 8cccc5c6-a29d-4e49-b32f-1de21877a16f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f', 'volume_size': 1} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:48:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1646708376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cccc5c6-a29d-4e49-b32f-1de21877a16f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dc8048ddebe0465ca9b2549191880835',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:48:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:48:49Z,use_quota=True,user_id='2475c55ed06447c9a3d4b2faf3c678b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Creating volume 8cccc5c6-a29d-4e49-b32f-1de21877a16f {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:48:49 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:48:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:49 devstack sudo[101053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f 1073741824 Sep 29 18:48:49 devstack sudo[101053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:50 devstack sudo[101053]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f 1073741824" returned: 0 in 0.559s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:50 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f Sep 29 18:48:50 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:50 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f" returned: 0 in 0.302s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:48:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9da439e-35c4-427e-9a71-8f433972c14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6519e0a1-82e9-4333-a888-16d426fd3224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:48:50 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Volume volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f (8cccc5c6-a29d-4e49-b32f-1de21877a16f): created successfully Sep 29 18:48:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6519e0a1-82e9-4333-a888-16d426fd3224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:48:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Flow 'volume_create_manager' (8e410d36-f9f3-4958-a096-ec70e3b5fbcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:48:50 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2f008429-cf25-4591-8fe9-a787c4194f58 tempest-VolumesTransfersV357Test-41075449 None] Created volume successfully. Sep 29 18:48:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Acquiring lock "cinder-8cccc5c6-a29d-4e49-b32f-1de21877a16f-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Lock "cinder-8cccc5c6-a29d-4e49-b32f-1de21877a16f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Acquiring lock "cinder-quobyte-8cccc5c6-a29d-4e49-b32f-1de21877a16f" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:48:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Lock "cinder-quobyte-8cccc5c6-a29d-4e49-b32f-1de21877a16f" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:48:52 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dd5683-2c00-40b9-9704-35f99cfc993f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:48:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:52 devstack sudo[101063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f Sep 29 18:48:52 devstack sudo[101063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:52 devstack sudo[101063]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f" returned: 0 in 0.438s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:52 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f Sep 29 18:48:52 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:52 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8cccc5c6-a29d-4e49-b32f-1de21877a16f" returned: 0 in 0.281s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Lock "cinder-quobyte-8cccc5c6-a29d-4e49-b32f-1de21877a16f" released by "delete_volume" :: held 0.785s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:52 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Created reservations ['8eb7a018-ed14-4c7b-bb83-6b50afbf3a71', '7bcbc16a-9316-40cf-936e-5e5831a5030c', 'b35c807a-e187-44ae-b030-381112db8850', '658e2a8e-d392-44ce-9eb9-7b40b39cb6a7'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:48:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:53 devstack sudo[101071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:48:53 devstack sudo[101071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:53 devstack sudo[101071]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.333s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:53 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:48:53 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Deleted volume successfully. Sep 29 18:48:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dac8c65a-cb07-47ad-9d0d-f82a32b73f35 tempest-VolumesTransfersV357Test-413327060 None] Lock "cinder-8cccc5c6-a29d-4e49-b32f-1de21877a16f-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:48:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:48:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:48:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:48:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:48:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:48:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:48:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:48:58 devstack sudo[101128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:48:58 devstack sudo[101128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:48:58 devstack sudo[101128]: pam_unix(sudo:session): session closed for user root Sep 29 18:48:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.351s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:48:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:48:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:48:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:48:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=32,cinder:UPDATE=47,cinder:DELETE=2,cinder:INSERT=12 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Flow 'volume_create_manager' (9639060f-dc6c-4885-a009-f2a5f9851334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80a727e-7ac3-40c3-9a6b-a91d741a0d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f80a727e-7ac3-40c3-9a6b-a91d741a0d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1850247212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d8859d-ddfd-446c-ba7d-7cd0a38aba04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbfba4701b744f79d0bb01dc919f045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:49:03Z,use_quota=True,user_id='9c21c5d9ea614528ba2ad89c9ba5b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bc52e1-28c3-4689-88a3-15aa01807752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06bc52e1-28c3-4689-88a3-15aa01807752) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d4516f-9a76-4924-9dd5-62eb992d801e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG cinder.image.glance [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Creating Keystone auth plugin from conf {{(pid=86523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d4516f-9a76-4924-9dd5-62eb992d801e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '69d8859d-ddfd-446c-ba7d-7cd0a38aba04', 'volume_name': 'volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7b71fc-d42f-4de8-b3c0-633fd436b4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7b71fc-d42f-4de8-b3c0-633fd436b4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3d0d68-46af-4705-96ed-c61fc12e6af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:03 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Volume 69d8859d-ddfd-446c-ba7d-7cd0a38aba04: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 18:49:03 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Trying to clone 69d8859d-ddfd-446c-ba7d-7cd0a38aba04 from image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]). {{(pid=86523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:49:04 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:49:04 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Image download 20.69 MB at 20.69 MB/s Sep 29 18:49:04 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4edddba6-d9eb-45e3-9e62-406c1a235389]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:49:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:04 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD Sep 29 18:49:04 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:04 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:04 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Temporary image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 is fetched for user 9c21c5d9ea614528ba2ad89c9ba5b8e0. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:49:04 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd16d115-0455-4ef1-89bb-df930c14de5e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:49:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:04 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD Sep 29 18:49:04 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:05 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:49:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1850247212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69d8859d-ddfd-446c-ba7d-7cd0a38aba04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbfba4701b744f79d0bb01dc919f045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:49:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:49:03Z,use_quota=True,user_id='9c21c5d9ea614528ba2ad89c9ba5b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Creating volume 69d8859d-ddfd-446c-ba7d-7cd0a38aba04 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:49:05 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:05 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 1073741824 Sep 29 18:49:05 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Flow 'volume_create_manager' (37152c2a-174e-4d7f-98c5-549325d5c064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e93b94-ca61-47a3-b8e1-9b9019a22473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:05 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70e93b94-ca61-47a3-b8e1-9b9019a22473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-532227052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be48c49-850c-4ab5-9fd1-23a9f30d467e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282687aa0ed744b386817ee10b43e1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:49:06Z,use_quota=True,user_id='467abfab87fe4d8e8bfcb969590d0466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10df47d2-8967-4ce1-b48b-607d10c3ca48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (10df47d2-8967-4ce1-b48b-607d10c3ca48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73da7693-b1db-46ea-991c-a2662b156bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73da7693-b1db-46ea-991c-a2662b156bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5be48c49-850c-4ab5-9fd1-23a9f30d467e', 'volume_name': 'volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ce5af0-8b30-4325-8a2b-043710459e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9ce5af0-8b30-4325-8a2b-043710459e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1e9e21-ab22-4595-9179-0e0e91ca5d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:05 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Volume 5be48c49-850c-4ab5-9fd1-23a9f30d467e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e', 'volume_size': 1} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 1073741824" returned: 0 in 0.654s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:05 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 Sep 29 18:49:05 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:06 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04" returned: 0 in 0.260s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.301s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:49:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-532227052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5be48c49-850c-4ab5-9fd1-23a9f30d467e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='282687aa0ed744b386817ee10b43e1e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:49:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:49:06Z,use_quota=True,user_id='467abfab87fe4d8e8bfcb969590d0466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Creating volume 5be48c49-850c-4ab5-9fd1-23a9f30d467e {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:49:06 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:06 devstack sudo[101265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e 1073741824 Sep 29 18:49:06 devstack sudo[101265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Attempting download of 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 ((None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}])) to volume 69d8859d-ddfd-446c-ba7d-7cd0a38aba04. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[741c23d0-5750-4715-8aaa-2eef8bea95e4]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_m_6g6ajy {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:06 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_m_6g6ajy Sep 29 18:49:06 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:06 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_m_6g6ajy" returned: 0 in 0.381s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_m_6g6ajy {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:06 devstack sudo[101265]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e 1073741824" returned: 0 in 0.531s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:06 devstack sudo[101275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e Sep 29 18:49:06 devstack sudo[101275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:06 devstack sudo[101274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_m_6g6ajy Sep 29 18:49:06 devstack sudo[101274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:06 devstack sudo[101274]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_m_6g6ajy" returned: 1 in 0.354s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_m_6g6ajy' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:49:06 devstack sudo[101275]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[82d7143c-5f16-438d-8c2d-3a50003a9c36]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e" returned: 0 in 0.275s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c1e9e21-ab22-4595-9179-0e0e91ca5d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3d06b0-8a0e-4b8c-a7bc-949ef602cff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:06 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Volume volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e (5be48c49-850c-4ab5-9fd1-23a9f30d467e): created successfully Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc3d06b0-8a0e-4b8c-a7bc-949ef602cff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Flow 'volume_create_manager' (37152c2a-174e-4d7f-98c5-549325d5c064) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:49:07 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2b48138f-dbf1-465e-8c79-d26084ddc042 tempest-TestMinimumBasicScenario-1820624756 None] Created volume successfully. Sep 29 18:49:07 devstack sudo[101281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD Sep 29 18:49:07 devstack sudo[101281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:07 devstack sudo[101281]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD" returned: 0 in 0.339s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:07 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 was qcow2, converting to qcow2 {{(pid=86523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:49:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:07 devstack sudo[101286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 Sep 29 18:49:07 devstack sudo[101286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-06e13f8f-0fae-472b-a4bd-efc88256ce47 req-5c0d5512-888d-4dc1-aa19-8877ba8a9c68 tempest-TestMinimumBasicScenario-1820624756 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-06e13f8f-0fae-472b-a4bd-efc88256ce47 req-5c0d5512-888d-4dc1-aa19-8877ba8a9c68 tempest-TestMinimumBasicScenario-1820624756 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-06e13f8f-0fae-472b-a4bd-efc88256ce47 req-5c0d5512-888d-4dc1-aa19-8877ba8a9c68 tempest-TestMinimumBasicScenario-1820624756 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-06e13f8f-0fae-472b-a4bd-efc88256ce47 req-5c0d5512-888d-4dc1-aa19-8877ba8a9c68 tempest-TestMinimumBasicScenario-1820624756 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '853eab69-43d0-47d3-80a9-755811184f38', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:49:09 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-06e13f8f-0fae-472b-a4bd-efc88256ce47 req-5c0d5512-888d-4dc1-aa19-8877ba8a9c68 tempest-TestMinimumBasicScenario-1820624756 None] attachment_update completed successfully. Sep 29 18:49:09 devstack sudo[101286]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04" returned: 0 in 2.120s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_7d6b3hb5devstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:49:09 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Converted 112.00 MB image at 52.82 MB/s Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:09 devstack sudo[101368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 1G Sep 29 18:49:09 devstack sudo[101368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:09 devstack sudo[101368]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 1G" returned: 0 in 0.389s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Downloaded image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 ((None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}])) to volume 69d8859d-ddfd-446c-ba7d-7cd0a38aba04 successfully. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Temporary image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 for user 9c21c5d9ea614528ba2ad89c9ba5b8e0 is deleted. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Marking volume 69d8859d-ddfd-446c-ba7d-7cd0a38aba04 as bootable. {{(pid=86523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Copying metadata from image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 to 69d8859d-ddfd-446c-ba7d-7cd0a38aba04. {{(pid=86523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Creating volume glance metadata for volume 69d8859d-ddfd-446c-ba7d-7cd0a38aba04 backed by image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a3d0d68-46af-4705-96ed-c61fc12e6af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327f21f3-8eee-486f-8038-3b7b180c2988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:09 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Volume volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 (69d8859d-ddfd-446c-ba7d-7cd0a38aba04): created successfully Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (327f21f3-8eee-486f-8038-3b7b180c2988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:09 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Flow 'volume_create_manager' (9639060f-dc6c-4885-a009-f2a5f9851334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:49:09 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-5fd6867a-d6ec-4ea5-a00f-a7f0d36f2345 tempest-VolumesExtendTest-2014033956 None] Created volume successfully. Sep 29 18:49:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d9d1569e-4c9e-48e9-af77-b9e5e00eb3a2 tempest-VolumesExtendTest-2014033956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d9d1569e-4c9e-48e9-af77-b9e5e00eb3a2 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:10 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3da761-a6bb-4346-be6b-51a205740409]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:49:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d9d1569e-4c9e-48e9-af77-b9e5e00eb3a2 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:11 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 Sep 29 18:49:11 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:11 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d9d1569e-4c9e-48e9-af77-b9e5e00eb3a2 tempest-VolumesExtendTest-2014033956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04" returned: 0 in 0.395s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d9d1569e-4c9e-48e9-af77-b9e5e00eb3a2 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 2G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d9d1569e-4c9e-48e9-af77-b9e5e00eb3a2 tempest-VolumesExtendTest-2014033956 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 2G" returned: 0 in 0.190s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d9d1569e-4c9e-48e9-af77-b9e5e00eb3a2 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.625s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:11 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d9d1569e-4c9e-48e9-af77-b9e5e00eb3a2 tempest-VolumesExtendTest-2014033956 None] Extend volume completed successfully. Sep 29 18:49:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Acquiring lock "cinder-69d8859d-ddfd-446c-ba7d-7cd0a38aba04-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:49:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Lock "cinder-69d8859d-ddfd-446c-ba7d-7cd0a38aba04-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:49:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Acquiring lock "cinder-quobyte-69d8859d-ddfd-446c-ba7d-7cd0a38aba04" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:49:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Lock "cinder-quobyte-69d8859d-ddfd-446c-ba7d-7cd0a38aba04" acquired by "delete_volume" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:49:12 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a819ca5d-bb43-48dc-8bb4-11830bf32253]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:49:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:12 devstack sudo[101743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 Sep 29 18:49:12 devstack sudo[101743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:12 devstack sudo[101743]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04" returned: 0 in 0.405s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:12 devstack sudo[101748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04 Sep 29 18:49:12 devstack sudo[101748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:13 devstack sudo[101748]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-69d8859d-ddfd-446c-ba7d-7cd0a38aba04" returned: 0 in 0.278s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Lock "cinder-quobyte-69d8859d-ddfd-446c-ba7d-7cd0a38aba04" released by "delete_volume" :: held 0.744s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:49:13 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Created reservations ['17f5e594-bdf1-43e6-8b8c-bcebe2efec3b', '847e09c0-850b-4659-8451-ccae067cbb08', '31c14a51-3384-44c0-8040-dab5ef89b5ae', '059b64f8-9d04-4290-9219-cd6779f0ab91'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:49:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:49:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:49:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:13 devstack sudo[101752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:49:13 devstack sudo[101752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:13 devstack sudo[101752]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.364s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:13 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:49:13 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Deleted volume successfully. Sep 29 18:49:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-fa2eadc3-8c8b-4033-90fa-c9c57b17c65b tempest-VolumesExtendTest-2014033956 None] Lock "cinder-69d8859d-ddfd-446c-ba7d-7cd0a38aba04-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Flow 'volume_create_manager' (a1038c4a-72c1-45b7-9b3d-fe735559c44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1653a89e-7f6f-4bba-a489-84b25000e93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1653a89e-7f6f-4bba-a489-84b25000e93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-11283435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00ef1c9-7031-4eae-8862-7c1173ac6096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbfba4701b744f79d0bb01dc919f045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:49:14Z,use_quota=True,user_id='9c21c5d9ea614528ba2ad89c9ba5b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54cdee3-a9db-4bca-924c-386eff7053a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c54cdee3-a9db-4bca-924c-386eff7053a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3481f403-b566-43ec-a53c-77348e3c8961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3481f403-b566-43ec-a53c-77348e3c8961) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f00ef1c9-7031-4eae-8862-7c1173ac6096', 'volume_name': 'volume-f00ef1c9-7031-4eae-8862-7c1173ac6096', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d10341-a406-4f8c-93b1-692d16674adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d10341-a406-4f8c-93b1-692d16674adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b6bd1a-df71-4c87-9579-3625dc853ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:14 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Volume f00ef1c9-7031-4eae-8862-7c1173ac6096: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f00ef1c9-7031-4eae-8862-7c1173ac6096', 'volume_size': 1} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:49:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-11283435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f00ef1c9-7031-4eae-8862-7c1173ac6096,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9dbfba4701b744f79d0bb01dc919f045',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:49:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:49:14Z,use_quota=True,user_id='9c21c5d9ea614528ba2ad89c9ba5b8e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Creating volume f00ef1c9-7031-4eae-8862-7c1173ac6096 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:49:14 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:49:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:14 devstack sudo[101757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 1073741824 Sep 29 18:49:14 devstack sudo[101757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:15 devstack sudo[101757]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 1073741824" returned: 0 in 0.599s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:15 devstack sudo[101763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 Sep 29 18:49:15 devstack sudo[101763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:15 devstack sudo[101763]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096" returned: 0 in 0.307s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:49:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2b6bd1a-df71-4c87-9579-3625dc853ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f00ef1c9-7031-4eae-8862-7c1173ac6096', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d864c63a-117d-4d55-9670-c4434f3742c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:15 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Volume volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 (f00ef1c9-7031-4eae-8862-7c1173ac6096): created successfully Sep 29 18:49:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d864c63a-117d-4d55-9670-c4434f3742c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Flow 'volume_create_manager' (a1038c4a-72c1-45b7-9b3d-fe735559c44a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:49:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-9bf36fef-50bc-4a5b-914e-b43a218e28c0 tempest-VolumesExtendTest-2014033956 None] Created volume successfully. Sep 29 18:49:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] Creating offline snapshot 3f49e328-10e2-4414-afab-0297f580e414 of volume f00ef1c9-7031-4eae-8862-7c1173ac6096 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:49:16 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[760c0c6b-3fac-4928-a670-2d13521b69a8]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:49:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:16 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 Sep 29 18:49:16 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:17 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096" returned: 0 in 0.392s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:17 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 1G Sep 29 18:49:17 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:17 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 1G" returned: 0 in 0.496s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:17 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 Sep 29 18:49:17 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:17 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414" returned: 0 in 0.319s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:17 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 is being set with open permissions: ugo+rw Sep 29 18:49:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:17 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 Sep 29 18:49:17 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:18 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414" returned: 0 in 0.248s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:18 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.info Sep 29 18:49:18 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:18 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.info" returned: 0 in 0.248s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:18 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.info is being set with open permissions: ugo+rw Sep 29 18:49:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:18 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.info Sep 29 18:49:18 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:18 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.info" returned: 0 in 0.255s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.079s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:18 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2adadc44-e226-4018-8519-21fb689147ee tempest-VolumesExtendTest-2014033956 None] Create snapshot completed successfully Sep 29 18:49:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e6d7494c-a287-48ce-9d40-87c85f33d646 tempest-VolumesExtendTest-2014033956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e6d7494c-a287-48ce-9d40-87c85f33d646 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:19 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[352c190c-f10a-4c17-9b91-57b4aeddf258]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:49:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e6d7494c-a287-48ce-9d40-87c85f33d646 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:20 devstack sudo[101812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 Sep 29 18:49:20 devstack sudo[101812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:20 devstack sudo[101812]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e6d7494c-a287-48ce-9d40-87c85f33d646 tempest-VolumesExtendTest-2014033956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096" returned: 0 in 0.368s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e6d7494c-a287-48ce-9d40-87c85f33d646 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 2G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e6d7494c-a287-48ce-9d40-87c85f33d646 tempest-VolumesExtendTest-2014033956 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 2G" returned: 0 in 0.125s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e6d7494c-a287-48ce-9d40-87c85f33d646 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.531s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e6d7494c-a287-48ce-9d40-87c85f33d646 tempest-VolumesExtendTest-2014033956 None] Extend volume completed successfully. Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Acquiring lock "cinder-3f49e328-10e2-4414-afab-0297f580e414-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Lock "cinder-3f49e328-10e2-4414-afab-0297f580e414-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Acquiring lock "cinder-quobyte-f00ef1c9-7031-4eae-8862-7c1173ac6096" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Lock "cinder-quobyte-f00ef1c9-7031-4eae-8862-7c1173ac6096" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Acquiring lock "cinder-quobyte-3f49e328-10e2-4414-afab-0297f580e414" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Lock "cinder-quobyte-3f49e328-10e2-4414-afab-0297f580e414" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Deleting offline snapshot 3f49e328-10e2-4414-afab-0297f580e414 of volume f00ef1c9-7031-4eae-8862-7c1173ac6096 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] snapshot_file for this snap is: volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f137072-25de-4ffb-8361-20b8dc3653a1]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:21 devstack sudo[101820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 Sep 29 18:49:21 devstack sudo[101820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:21 devstack sudo[101820]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414" returned: 0 in 0.356s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f00ef1c9-7031-4eae-8862-7c1173ac6096(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e6176d-fbd8-49fd-8d2d-a4e1c9925820]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:21 devstack sudo[101825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 Sep 29 18:49:21 devstack sudo[101825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:21 devstack sudo[101825]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096" returned: 0 in 0.353s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:21 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 Sep 29 18:49:21 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:22 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414" returned: 0 in 0.370s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:22 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414 Sep 29 18:49:22 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:22 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096.3f49e328-10e2-4414-afab-0297f580e414" returned: 0 in 0.248s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Lock "cinder-quobyte-3f49e328-10e2-4414-afab-0297f580e414" released by "_delete_snapshot" :: held 1.440s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:49:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Lock "cinder-quobyte-f00ef1c9-7031-4eae-8862-7c1173ac6096" released by "delete_snapshot" :: held 1.468s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:49:22 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Created reservations ['9029dfae-0751-48b7-9285-2a4234679281', '8114f139-9d9d-4289-99ab-795fe33f0bfb', 'a5a7278b-256e-4aeb-b5d2-f85277c48300', '383d6fcd-79cf-4e1c-b1ee-238b452f7fde'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:49:22 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Delete snapshot completed successfully. Sep 29 18:49:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-aeb46ff1-48a3-482a-966d-8c300ab52b8b tempest-VolumesExtendTest-2014033956 None] Lock "cinder-3f49e328-10e2-4414-afab-0297f580e414-delete_snapshot" released by "delete_snapshot" :: held 1.593s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:49:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Acquiring lock "cinder-f00ef1c9-7031-4eae-8862-7c1173ac6096-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:49:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Lock "cinder-f00ef1c9-7031-4eae-8862-7c1173ac6096-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:49:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Acquiring lock "cinder-quobyte-f00ef1c9-7031-4eae-8862-7c1173ac6096" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:49:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Lock "cinder-quobyte-f00ef1c9-7031-4eae-8862-7c1173ac6096" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:49:23 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2175271c-d7fa-4fff-87a8-3af32ef70755]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:49:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:23 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 Sep 29 18:49:23 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:23 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096" returned: 0 in 0.384s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:23 devstack sudo[101844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096 Sep 29 18:49:23 devstack sudo[101844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:24 devstack sudo[101844]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f00ef1c9-7031-4eae-8862-7c1173ac6096" returned: 0 in 0.252s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Lock "cinder-quobyte-f00ef1c9-7031-4eae-8862-7c1173ac6096" released by "delete_volume" :: held 0.705s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:49:24 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Created reservations ['0db5ba0d-2eba-4b60-8cc7-f8e7394e9c6e', 'dfb14d33-fb37-47bd-b1be-b9d674e291b0', '7f1d89d2-8a19-4557-ae4a-45739e8fbd2f', 'd3b625dc-9b63-4152-849e-7c3f3c687fd1'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:49:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:49:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:49:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:24 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:49:24 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:24 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.266s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:24 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:49:24 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Deleted volume successfully. Sep 29 18:49:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-63f8657c-043f-442c-a069-11226dbaff18 tempest-VolumesExtendTest-2014033956 None] Lock "cinder-f00ef1c9-7031-4eae-8862-7c1173ac6096-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Flow 'volume_create_manager' (748d18a0-8888-4f18-bf9b-8e37622a46b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542b02c6-f284-4ac5-8c7c-c0608c3f1a7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542b02c6-f284-4ac5-8c7c-c0608c3f1a7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-709694302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ca68be-2672-4419-80af-9ddf5563a9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1001dfcb3d49358b1ef82ff4568609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:49:28Z,use_quota=True,user_id='06b55bf775914c28b4d46478152fcb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5b1ace-685e-4cff-8211-a8cae1792872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea5b1ace-685e-4cff-8211-a8cae1792872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f3183d-f8e2-455e-ab68-cd41db02d621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81f3183d-f8e2-455e-ab68-cd41db02d621) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ca68be-2672-4419-80af-9ddf5563a9ac', 'volume_name': 'volume-15ca68be-2672-4419-80af-9ddf5563a9ac', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb53ccd-43a8-4b0f-a4b3-7656c0d65efa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cb53ccd-43a8-4b0f-a4b3-7656c0d65efa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca2a8ee-de5b-422e-8d13-94b0d34a6e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:28 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Volume 15ca68be-2672-4419-80af-9ddf5563a9ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ca68be-2672-4419-80af-9ddf5563a9ac', 'volume_size': 1} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:49:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-709694302',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ca68be-2672-4419-80af-9ddf5563a9ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c1001dfcb3d49358b1ef82ff4568609',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:49:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:49:28Z,use_quota=True,user_id='06b55bf775914c28b4d46478152fcb0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Creating volume 15ca68be-2672-4419-80af-9ddf5563a9ac {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:49:28 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-15ca68be-2672-4419-80af-9ddf5563a9ac 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:28 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-15ca68be-2672-4419-80af-9ddf5563a9ac 1073741824 Sep 29 18:49:28 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:28 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-15ca68be-2672-4419-80af-9ddf5563a9ac 1073741824" returned: 0 in 0.441s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-15ca68be-2672-4419-80af-9ddf5563a9ac {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:28 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-15ca68be-2672-4419-80af-9ddf5563a9ac Sep 29 18:49:28 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:29 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-15ca68be-2672-4419-80af-9ddf5563a9ac" returned: 0 in 0.265s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:49:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ca2a8ee-de5b-422e-8d13-94b0d34a6e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ca68be-2672-4419-80af-9ddf5563a9ac', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b5e8ca-b6f6-40dc-9b0b-b33b6b5f83dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:49:29 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Volume volume-15ca68be-2672-4419-80af-9ddf5563a9ac (15ca68be-2672-4419-80af-9ddf5563a9ac): created successfully Sep 29 18:49:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25b5e8ca-b6f6-40dc-9b0b-b33b6b5f83dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:49:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Flow 'volume_create_manager' (748d18a0-8888-4f18-bf9b-8e37622a46b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:49:29 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f7300ddf-dbbe-4e43-ad44-8f2e1b7b07a8 tempest-VolumesNegativeTest-1246562147 None] Created volume successfully. Sep 29 18:49:39 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=41,cinder:SELECT=43,cinder:INSERT=18,cinder:DELETE=3 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:49:39 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=77,cinder:UPDATE=91,cinder:INSERT=23,cinder:DELETE=9 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:49:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Acquiring lock "cinder-15ca68be-2672-4419-80af-9ddf5563a9ac-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:49:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Lock "cinder-15ca68be-2672-4419-80af-9ddf5563a9ac-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:49:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Acquiring lock "cinder-quobyte-15ca68be-2672-4419-80af-9ddf5563a9ac" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:49:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Lock "cinder-quobyte-15ca68be-2672-4419-80af-9ddf5563a9ac" acquired by "delete_volume" :: waited 0.013s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:49:47 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[604a1825-dd39-4140-8ea0-8aaf6f4263a0]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:49:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-15ca68be-2672-4419-80af-9ddf5563a9ac {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:47 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-15ca68be-2672-4419-80af-9ddf5563a9ac Sep 29 18:49:47 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:47 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-15ca68be-2672-4419-80af-9ddf5563a9ac" returned: 0 in 0.361s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-15ca68be-2672-4419-80af-9ddf5563a9ac {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:47 devstack sudo[102077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-15ca68be-2672-4419-80af-9ddf5563a9ac Sep 29 18:49:47 devstack sudo[102077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:48 devstack sudo[102077]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-15ca68be-2672-4419-80af-9ddf5563a9ac" returned: 0 in 0.242s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Lock "cinder-quobyte-15ca68be-2672-4419-80af-9ddf5563a9ac" released by "delete_volume" :: held 0.646s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:49:48 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Created reservations ['7c394bf2-1ef3-4d3e-b66b-c116af1befea', '12a45b7e-eae2-47f3-bfe5-2c4488f52b60', '9243face-2a03-49a3-aaac-ee91ba020a18', 'd999d266-d38e-46c0-b48f-502be846cffa'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:49:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:49:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:49:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:48 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:49:48 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:48 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.251s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:48 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:49:48 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Deleted volume successfully. Sep 29 18:49:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-36d29efb-7dd3-427f-9442-8d431921aa41 tempest-VolumesNegativeTest-1246562147 None] Lock "cinder-15ca68be-2672-4419-80af-9ddf5563a9ac-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:49:56 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-07dd3c6f-10d1-4091-809b-a5fc204bb750 req-893e8b58-604b-4008-a140-06e9acb7fbff tempest-TestMinimumBasicScenario-1820624756 None] Terminate volume connection completed successfully. Sep 29 18:49:56 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-07dd3c6f-10d1-4091-809b-a5fc204bb750 req-893e8b58-604b-4008-a140-06e9acb7fbff tempest-TestMinimumBasicScenario-1820624756 None] Deleting attachment 853eab69-43d0-47d3-80a9-755811184f38. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:49:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Acquiring lock "cinder-5be48c49-850c-4ab5-9fd1-23a9f30d467e-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:49:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Lock "cinder-5be48c49-850c-4ab5-9fd1-23a9f30d467e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:49:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Acquiring lock "cinder-quobyte-5be48c49-850c-4ab5-9fd1-23a9f30d467e" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:49:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Lock "cinder-quobyte-5be48c49-850c-4ab5-9fd1-23a9f30d467e" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:49:57 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f058a6-19b0-48f8-b79f-d9839e9655ed]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:49:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:57 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e Sep 29 18:49:57 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:57 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e" returned: 0 in 0.442s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:57 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e Sep 29 18:49:57 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:57 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5be48c49-850c-4ab5-9fd1-23a9f30d467e" returned: 0 in 0.284s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Lock "cinder-quobyte-5be48c49-850c-4ab5-9fd1-23a9f30d467e" released by "delete_volume" :: held 0.807s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Created reservations ['96a6e1e8-6fc6-4f85-a681-b351b34b496e', '78b7a545-13b6-426b-9f9d-94f0f86d43af', 'f6dc4e75-1c8b-4548-a1ae-650632542196', 'e0ec167d-574b-46ff-a7fe-a918ad7f75fb'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:58 devstack sudo[102114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:49:58 devstack sudo[102114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:49:58 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:49:58 devstack sudo[102114]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:58 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.472s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:49:58 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Deleted volume successfully. Sep 29 18:49:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6b8f4463-1ed7-4aad-8e14-1e2b0fc0d29c tempest-TestMinimumBasicScenario-1820624756 None] Lock "cinder-5be48c49-850c-4ab5-9fd1-23a9f30d467e-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:49:59 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Sep 29 18:49:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.407s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:49:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:49:59 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:49:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:49:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:50:08 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=18,cinder:SELECT=11,cinder:INSERT=5 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:50:08 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=14,cinder:DELETE=2 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Flow 'volume_create_manager' (8a124a99-dda6-48d7-a66d-a748be10410f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46042589-0a2c-4d79-a17e-247f65647e8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46042589-0a2c-4d79-a17e-247f65647e8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2025894150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5df2fcd-3025-4cbd-97df-10b7fb37fa74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5774ad8f35f34f31837017cf2701a3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:14Z,use_quota=True,user_id='2bb32b12ffbc4b639ba50d0278133c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e9b06d-8e73-424a-8aa6-02a780949b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33e9b06d-8e73-424a-8aa6-02a780949b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205260db-1707-49e9-bf33-57f6ce53fe94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (205260db-1707-49e9-bf33-57f6ce53fe94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5df2fcd-3025-4cbd-97df-10b7fb37fa74', 'volume_name': 'volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3005fc99-b2f6-4def-9838-53cbe8e5da25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3005fc99-b2f6-4def-9838-53cbe8e5da25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f26ad3e-2d63-4471-a263-668d1266ecd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:14 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Volume c5df2fcd-3025-4cbd-97df-10b7fb37fa74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74', 'volume_size': 1} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2025894150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5df2fcd-3025-4cbd-97df-10b7fb37fa74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5774ad8f35f34f31837017cf2701a3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:14Z,use_quota=True,user_id='2bb32b12ffbc4b639ba50d0278133c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Creating volume c5df2fcd-3025-4cbd-97df-10b7fb37fa74 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:50:14 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:50:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:14 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74 1073741824 Sep 29 18:50:14 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:15 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74 1073741824" returned: 0 in 0.449s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:15 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74 Sep 29 18:50:15 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:15 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74" returned: 0 in 0.256s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f26ad3e-2d63-4471-a263-668d1266ecd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bddb61-c2e4-487b-9f40-166a179ac3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:15 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Volume volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74 (c5df2fcd-3025-4cbd-97df-10b7fb37fa74): created successfully Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3bddb61-c2e4-487b-9f40-166a179ac3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Flow 'volume_create_manager' (8a124a99-dda6-48d7-a66d-a748be10410f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-93acb32f-3fd2-4e4d-8f35-2f31d09db0ac tempest-ProjectReaderTests-1288260622 None] Created volume successfully. Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Acquiring lock "cinder-c5df2fcd-3025-4cbd-97df-10b7fb37fa74-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Lock "cinder-c5df2fcd-3025-4cbd-97df-10b7fb37fa74-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Acquiring lock "cinder-quobyte-c5df2fcd-3025-4cbd-97df-10b7fb37fa74" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Lock "cinder-quobyte-c5df2fcd-3025-4cbd-97df-10b7fb37fa74" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[45f2abf3-df64-4eb1-86a6-1e1c111d4092]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:50:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:15 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74 Sep 29 18:50:15 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:16 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74" returned: 0 in 0.392s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:16 devstack sudo[102212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74 Sep 29 18:50:16 devstack sudo[102212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:16 devstack sudo[102212]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c5df2fcd-3025-4cbd-97df-10b7fb37fa74" returned: 0 in 0.268s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Lock "cinder-quobyte-c5df2fcd-3025-4cbd-97df-10b7fb37fa74" released by "delete_volume" :: held 0.708s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Created reservations ['d7a9d139-abd9-4742-82d1-fbccb2dac422', '8b0dd6ac-ea3e-45db-8fb0-80d1e1a2b038', 'c014e611-e787-430c-b7e5-8f5cfe19163f', '7c3647e0-773d-4614-bc81-9a1728344191'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:16 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:50:16 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Flow 'volume_create_manager' (5219c529-543a-445d-9038-d4477f84c490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ef0e40-6c1e-4a46-a9a0-1deee864c005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ef0e40-6c1e-4a46-a9a0-1deee864c005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-910320820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad2637a-3c93-4b08-8b37-fc1d784d10f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b95ad75aa16479a9537d52a468515ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:17Z,use_quota=True,user_id='bade2050d8854611b474d74b36958bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a906c62c-94a5-4c01-b3ad-76f2aecceb48),volume_type_id=a906c62c-94a5-4c01-b3ad-76f2aecceb48)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b09645-240e-4f93-85af-7e7466269a3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52b09645-240e-4f93-85af-7e7466269a3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7d305f-6058-4eca-adde-ecda5a6f58f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a7d305f-6058-4eca-adde-ecda5a6f58f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aad2637a-3c93-4b08-8b37-fc1d784d10f5', 'volume_name': 'volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7426f1-5c86-49bb-b02e-547c17cbb500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf7426f1-5c86-49bb-b02e-547c17cbb500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1c5e3e-148b-4292-828c-b8760eb4c615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:16 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Volume aad2637a-3c93-4b08-8b37-fc1d784d10f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5', 'volume_size': 1} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-910320820',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aad2637a-3c93-4b08-8b37-fc1d784d10f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b95ad75aa16479a9537d52a468515ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:17Z,use_quota=True,user_id='bade2050d8854611b474d74b36958bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a906c62c-94a5-4c01-b3ad-76f2aecceb48),volume_type_id=a906c62c-94a5-4c01-b3ad-76f2aecceb48)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Creating volume aad2637a-3c93-4b08-8b37-fc1d784d10f5 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:50:16 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:16 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5 1073741824 Sep 29 18:50:16 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:16 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.335s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:16 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:50:17 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Deleted volume successfully. Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e52ffde1-0bae-4ec5-bff9-df141ffd3a22 tempest-ProjectReaderTests-1288260622 None] Lock "cinder-c5df2fcd-3025-4cbd-97df-10b7fb37fa74-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Flow 'volume_create_manager' (9e98a0d9-1db6-4bb7-be01-663069778db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2827c4c1-02c5-4ae4-abed-890429f877cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2827c4c1-02c5-4ae4-abed-890429f877cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-413696223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66ddd3d-d620-4573-94ea-c2c657e695b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b95ad75aa16479a9537d52a468515ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:17Z,use_quota=True,user_id='bade2050d8854611b474d74b36958bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(678c6039-ec76-4141-87d8-0a2b459bc3a5),volume_type_id=678c6039-ec76-4141-87d8-0a2b459bc3a5)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be65e5b-6be4-4c04-b287-06a19487269e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1be65e5b-6be4-4c04-b287-06a19487269e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f77a2c9-11e2-489d-ac4f-ddb3e65b498c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f77a2c9-11e2-489d-ac4f-ddb3e65b498c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e66ddd3d-d620-4573-94ea-c2c657e695b6', 'volume_name': 'volume-e66ddd3d-d620-4573-94ea-c2c657e695b6', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f30924-a5c4-4c46-a5a5-519ad10c38bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81f30924-a5c4-4c46-a5a5-519ad10c38bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d286cb-3132-4587-b8c9-9a64dddee318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Volume e66ddd3d-d620-4573-94ea-c2c657e695b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e66ddd3d-d620-4573-94ea-c2c657e695b6', 'volume_size': 1} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:17 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5 1073741824" returned: 0 in 0.594s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:17 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5 Sep 29 18:50:17 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Flow 'volume_create_manager' (df8bed2a-5c95-41f0-ac07-e717fe75febc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de52d581-4acc-4836-9799-9aa447dfe4fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de52d581-4acc-4836-9799-9aa447dfe4fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960406292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8417c195-b437-49da-a567-8f001d0924e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5774ad8f35f34f31837017cf2701a3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:18Z,use_quota=True,user_id='2bb32b12ffbc4b639ba50d0278133c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fe6c75-6902-4b7d-b506-369ff2eb23dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52fe6c75-6902-4b7d-b506-369ff2eb23dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dff0c6-f6e5-4d66-8ee0-5ba6983459fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61dff0c6-f6e5-4d66-8ee0-5ba6983459fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8417c195-b437-49da-a567-8f001d0924e1', 'volume_name': 'volume-8417c195-b437-49da-a567-8f001d0924e1', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136ae160-df18-44ed-a01d-2992136d1460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (136ae160-df18-44ed-a01d-2992136d1460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5feeec-a876-41cb-89cf-16e11a56863f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Volume 8417c195-b437-49da-a567-8f001d0924e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8417c195-b437-49da-a567-8f001d0924e1', 'volume_size': 1} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:17 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5" returned: 0 in 0.287s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.418s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-413696223',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e66ddd3d-d620-4573-94ea-c2c657e695b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b95ad75aa16479a9537d52a468515ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:17Z,use_quota=True,user_id='bade2050d8854611b474d74b36958bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(678c6039-ec76-4141-87d8-0a2b459bc3a5),volume_type_id=678c6039-ec76-4141-87d8-0a2b459bc3a5)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Creating volume e66ddd3d-d620-4573-94ea-c2c657e695b6 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:50:17 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e66ddd3d-d620-4573-94ea-c2c657e695b6 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:17 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e66ddd3d-d620-4573-94ea-c2c657e695b6 1073741824 Sep 29 18:50:17 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b1c5e3e-148b-4292-828c-b8760eb4c615) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b917ac7-91b9-47af-8a42-7976772fe076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Volume volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5 (aad2637a-3c93-4b08-8b37-fc1d784d10f5): created successfully Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b917ac7-91b9-47af-8a42-7976772fe076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Flow 'volume_create_manager' (5219c529-543a-445d-9038-d4477f84c490) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:17 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-40966d01-c87d-4c81-83af-8cf57e0daa54 tempest-TestInstancesWithCinderVolumes-1932414750 None] Created volume successfully. Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Flow 'volume_create_manager' (e0931dab-4f8e-4037-9978-6713acd2ed12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b10fb5-5474-4e25-8f5b-6957f80c0da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28b10fb5-5474-4e25-8f5b-6957f80c0da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-345396432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36bcdab-268f-4edf-b7a6-ea96a38f8317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b95ad75aa16479a9537d52a468515ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:18Z,use_quota=True,user_id='bade2050d8854611b474d74b36958bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b2bab4f-8a26-4856-92e8-8023f6a4fae3),volume_type_id=4b2bab4f-8a26-4856-92e8-8023f6a4fae3)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687a0b52-ff4b-4072-bba9-9360eda59101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (687a0b52-ff4b-4072-bba9-9360eda59101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38129c00-d14e-4105-a401-d242245ad60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:17 devstack cinder-volume[86523]: DEBUG cinder.image.glance [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Creating Keystone auth plugin from conf {{(pid=86523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:50:18 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e66ddd3d-d620-4573-94ea-c2c657e695b6 1073741824" returned: 0 in 0.499s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38129c00-d14e-4105-a401-d242245ad60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a36bcdab-268f-4edf-b7a6-ea96a38f8317', 'volume_name': 'volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317', 'volume_size': 1, 'image_id': '2f54a6c1-bf82-403f-891d-4d810f1e0c53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f54a6c1-bf82-403f-891d-4d810f1e0c53', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1837955583', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b95ad75aa16479a9537d52a468515ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f54a6c1-bf82-403f-891d-4d810f1e0c53', 'created_at': datetime.datetime(2026, 9, 29, 16, 50, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 50, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f54a6c1-bf82-403f-891d-4d810f1e0c53/file', 'properties': {}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1275b93-1e8e-4489-941d-2e5da3aa28a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1275b93-1e8e-4489-941d-2e5da3aa28a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b312520-4347-4887-9ff2-0c0f4246ff38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:18 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Volume a36bcdab-268f-4edf-b7a6-ea96a38f8317: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317', 'volume_size': 1, 'image_id': '2f54a6c1-bf82-403f-891d-4d810f1e0c53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f54a6c1-bf82-403f-891d-4d810f1e0c53', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1837955583', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b95ad75aa16479a9537d52a468515ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f54a6c1-bf82-403f-891d-4d810f1e0c53', 'created_at': datetime.datetime(2026, 9, 29, 16, 50, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 50, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f54a6c1-bf82-403f-891d-4d810f1e0c53/file', 'properties': {}}, 'image_service': } Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Trying to clone a36bcdab-268f-4edf-b7a6-ea96a38f8317 from image 2f54a6c1-bf82-403f-891d-4d810f1e0c53 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2f54a6c1-bf82-403f-891d-4d810f1e0c53', 'metadata': {}}]). {{(pid=86523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e66ddd3d-d620-4573-94ea-c2c657e695b6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:18 devstack sudo[102233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e66ddd3d-d620-4573-94ea-c2c657e695b6 Sep 29 18:50:18 devstack sudo[102233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:18 devstack sudo[102233]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e66ddd3d-d620-4573-94ea-c2c657e695b6" returned: 0 in 0.253s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.911s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1960406292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8417c195-b437-49da-a567-8f001d0924e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5774ad8f35f34f31837017cf2701a3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:18Z,use_quota=True,user_id='2bb32b12ffbc4b639ba50d0278133c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Creating volume 8417c195-b437-49da-a567-8f001d0924e1 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:50:18 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8417c195-b437-49da-a567-8f001d0924e1 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:18 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8417c195-b437-49da-a567-8f001d0924e1 1073741824 Sep 29 18:50:18 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d286cb-3132-4587-b8c9-9a64dddee318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e66ddd3d-d620-4573-94ea-c2c657e695b6', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b4b71d-e9f8-4ffe-92bc-c1e1b8be82fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:18 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Volume volume-e66ddd3d-d620-4573-94ea-c2c657e695b6 (e66ddd3d-d620-4573-94ea-c2c657e695b6): created successfully Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b4b71d-e9f8-4ffe-92bc-c1e1b8be82fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Flow 'volume_create_manager' (9e98a0d9-1db6-4bb7-be01-663069778db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:18 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e1b917a4-ded5-447e-ae78-07e8116aeaa9 tempest-TestInstancesWithCinderVolumes-1932414750 None] Created volume successfully. Sep 29 18:50:19 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8417c195-b437-49da-a567-8f001d0924e1 1073741824" returned: 0 in 0.442s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8417c195-b437-49da-a567-8f001d0924e1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:19 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8417c195-b437-49da-a567-8f001d0924e1 Sep 29 18:50:19 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:19 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8417c195-b437-49da-a567-8f001d0924e1" returned: 0 in 0.271s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed5feeec-a876-41cb-89cf-16e11a56863f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8417c195-b437-49da-a567-8f001d0924e1', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720174b5-3bd1-496c-9117-46f744b69cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:19 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Volume volume-8417c195-b437-49da-a567-8f001d0924e1 (8417c195-b437-49da-a567-8f001d0924e1): created successfully Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720174b5-3bd1-496c-9117-46f744b69cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Flow 'volume_create_manager' (df8bed2a-5c95-41f0-ac07-e717fe75febc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:19 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-174fb4e7-18c7-4bc6-a2ce-7d079edb898c tempest-ProjectReaderTests-1288260622 None] Created volume successfully. Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Acquiring lock "cinder-8417c195-b437-49da-a567-8f001d0924e1-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Lock "cinder-8417c195-b437-49da-a567-8f001d0924e1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Acquiring lock "cinder-quobyte-8417c195-b437-49da-a567-8f001d0924e1" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Lock "cinder-quobyte-8417c195-b437-49da-a567-8f001d0924e1" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[01ccd858-a9ab-409f-a0ea-b94f15672c7a]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:50:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8417c195-b437-49da-a567-8f001d0924e1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:19 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8417c195-b437-49da-a567-8f001d0924e1 Sep 29 18:50:19 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:20 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8417c195-b437-49da-a567-8f001d0924e1" returned: 0 in 0.384s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8417c195-b437-49da-a567-8f001d0924e1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:20 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8417c195-b437-49da-a567-8f001d0924e1 Sep 29 18:50:20 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:20 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8417c195-b437-49da-a567-8f001d0924e1" returned: 0 in 0.286s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Lock "cinder-quobyte-8417c195-b437-49da-a567-8f001d0924e1" released by "delete_volume" :: held 0.711s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:50:20 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Created reservations ['61a6e34b-d259-43b6-a201-dca9c1c5c72a', 'fc54aa27-c050-4b33-8db0-3b493436df34', 'b9d44c76-59a5-42b9-b55f-ba7e86a663b3', '6c63690c-5d06-413d-a7e2-49011ee9193e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:50:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:50:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:50:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:20 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:50:20 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:20 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.275s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:20 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:50:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Deleted volume successfully. Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ec1c4a9f-3c13-40f4-842a-440e7e365725 tempest-ProjectReaderTests-1288260622 None] Lock "cinder-8417c195-b437-49da-a567-8f001d0924e1-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Flow 'volume_create_manager' (8e0fc8c1-82a5-401c-bcd2-fa36f6a28515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8948ae31-3ba7-4435-8f5b-e3731dfbc7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8948ae31-3ba7-4435-8f5b-e3731dfbc7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1300023399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72760b60-03fe-469f-8c76-404a8b0c0445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5774ad8f35f34f31837017cf2701a3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:21Z,use_quota=True,user_id='2bb32b12ffbc4b639ba50d0278133c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2665a537-57e7-40bb-afb1-669c0eac3d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2665a537-57e7-40bb-afb1-669c0eac3d01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86508a95-2035-498c-bbd2-46a11328a638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86508a95-2035-498c-bbd2-46a11328a638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72760b60-03fe-469f-8c76-404a8b0c0445', 'volume_name': 'volume-72760b60-03fe-469f-8c76-404a8b0c0445', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2879eec3-1951-4e68-bb97-3e07199fdddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2879eec3-1951-4e68-bb97-3e07199fdddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5144652-a364-45f5-a4b2-249fe2258f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:21 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Volume 72760b60-03fe-469f-8c76-404a8b0c0445: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72760b60-03fe-469f-8c76-404a8b0c0445', 'volume_size': 1} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1300023399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72760b60-03fe-469f-8c76-404a8b0c0445,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5774ad8f35f34f31837017cf2701a3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:21Z,use_quota=True,user_id='2bb32b12ffbc4b639ba50d0278133c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Creating volume 72760b60-03fe-469f-8c76-404a8b0c0445 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:50:21 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-72760b60-03fe-469f-8c76-404a8b0c0445 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:21 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-72760b60-03fe-469f-8c76-404a8b0c0445 1073741824 Sep 29 18:50:21 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD, size 20.69 MB, duration 3.59 sec {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:50:21 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Image download 20.69 MB at 5.76 MB/s Sep 29 18:50:21 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-72760b60-03fe-469f-8c76-404a8b0c0445 1073741824" returned: 0 in 0.440s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f759674-cedd-47cd-b53c-ec207960e4dd]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:50:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-72760b60-03fe-469f-8c76-404a8b0c0445 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:22 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-72760b60-03fe-469f-8c76-404a8b0c0445 Sep 29 18:50:22 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:22 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD Sep 29 18:50:22 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:22 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-72760b60-03fe-469f-8c76-404a8b0c0445" returned: 0 in 0.258s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5144652-a364-45f5-a4b2-249fe2258f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72760b60-03fe-469f-8c76-404a8b0c0445', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c0531c-b6b6-4bc3-a721-e5d1f17344da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:22 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Volume volume-72760b60-03fe-469f-8c76-404a8b0c0445 (72760b60-03fe-469f-8c76-404a8b0c0445): created successfully Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9c0531c-b6b6-4bc3-a721-e5d1f17344da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Flow 'volume_create_manager' (8e0fc8c1-82a5-401c-bcd2-fa36f6a28515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:22 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Temporary image 2f54a6c1-bf82-403f-891d-4d810f1e0c53 is fetched for user bade2050d8854611b474d74b36958bbc. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:50:22 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-82e80cd1-fa2b-46c2-ade5-659c88de2afe tempest-ProjectReaderTests-1288260622 None] Created volume successfully. Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec9092c-a9c7-4143-9904-03480a8a26fd]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:22 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD Sep 29 18:50:22 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Acquiring lock "cinder-72760b60-03fe-469f-8c76-404a8b0c0445-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Lock "cinder-72760b60-03fe-469f-8c76-404a8b0c0445-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Acquiring lock "cinder-quobyte-72760b60-03fe-469f-8c76-404a8b0c0445" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Lock "cinder-quobyte-72760b60-03fe-469f-8c76-404a8b0c0445" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49adb44-cd4d-4006-bd07-57ab31daeee0]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-72760b60-03fe-469f-8c76-404a8b0c0445 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:22 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-72760b60-03fe-469f-8c76-404a8b0c0445 Sep 29 18:50:22 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:22 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-345396432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36bcdab-268f-4edf-b7a6-ea96a38f8317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8b95ad75aa16479a9537d52a468515ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:18Z,use_quota=True,user_id='bade2050d8854611b474d74b36958bbc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4b2bab4f-8a26-4856-92e8-8023f6a4fae3),volume_type_id=4b2bab4f-8a26-4856-92e8-8023f6a4fae3)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Creating volume a36bcdab-268f-4edf-b7a6-ea96a38f8317 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:50:22 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:22 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 1073741824 Sep 29 18:50:22 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:22 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-72760b60-03fe-469f-8c76-404a8b0c0445" returned: 0 in 0.368s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-72760b60-03fe-469f-8c76-404a8b0c0445 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:23 devstack sudo[102284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-72760b60-03fe-469f-8c76-404a8b0c0445 Sep 29 18:50:23 devstack sudo[102284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:23 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 1073741824" returned: 0 in 0.445s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:23 devstack sudo[102284]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-72760b60-03fe-469f-8c76-404a8b0c0445" returned: 0 in 0.264s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:23 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Lock "cinder-quobyte-72760b60-03fe-469f-8c76-404a8b0c0445" released by "delete_volume" :: held 0.678s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:50:23 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Created reservations ['9cb2ffc6-7024-430e-ac6d-5ccca88af066', 'a2f46c95-42b2-43f0-8b91-a102e6c246b9', '047cd40f-fdb4-459f-ad7a-3bf30cca73cc', 'fafd26c3-8b79-40b1-b495-58080198de1e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:23 devstack sudo[102292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:50:23 devstack sudo[102292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:23 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317" returned: 0 in 0.253s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Attempting download of 2f54a6c1-bf82-403f-891d-4d810f1e0c53 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f54a6c1-bf82-403f-891d-4d810f1e0c53', 'metadata': {}}])) to volume a36bcdab-268f-4edf-b7a6-ea96a38f8317. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e079f99b-35c9-4327-aa30-4b9c2a2c0fbc]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f54a6c1-bf82-403f-891d-4d810f1e0c53_0f_vpq5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:23 devstack sudo[102292]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.268s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:50:23 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Deleted volume successfully. Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1d260716-fc89-4301-8b36-e0f16da9d1ee tempest-ProjectReaderTests-1288260622 None] Lock "cinder-72760b60-03fe-469f-8c76-404a8b0c0445-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:50:23 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f54a6c1-bf82-403f-891d-4d810f1e0c53_0f_vpq5e Sep 29 18:50:23 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:23 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2f54a6c1-bf82-403f-891d-4d810f1e0c53_0f_vpq5e" returned: 0 in 0.366s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f54a6c1-bf82-403f-891d-4d810f1e0c53_0f_vpq5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:24 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f54a6c1-bf82-403f-891d-4d810f1e0c53_0f_vpq5e Sep 29 18:50:24 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Flow 'volume_create_manager' (df065e34-ca18-499f-8d12-27a7be464fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6e1044-a65c-4d5f-b9b1-b6aa03ab9738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d6e1044-a65c-4d5f-b9b1-b6aa03ab9738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581703687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6134fadb-39bb-4831-9efe-9578a9ac6336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5774ad8f35f34f31837017cf2701a3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:24Z,use_quota=True,user_id='2bb32b12ffbc4b639ba50d0278133c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82d80ec-a224-4058-9944-76d410fc1475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b82d80ec-a224-4058-9944-76d410fc1475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3b02b6-b34f-4dab-a977-ea467222dd33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d3b02b6-b34f-4dab-a977-ea467222dd33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6134fadb-39bb-4831-9efe-9578a9ac6336', 'volume_name': 'volume-6134fadb-39bb-4831-9efe-9578a9ac6336', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6cb41d-d065-4ad9-acea-ee38feadc0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c6cb41d-d065-4ad9-acea-ee38feadc0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f1fc32-507e-4e00-bd05-280fa5ace6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:24 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Volume 6134fadb-39bb-4831-9efe-9578a9ac6336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6134fadb-39bb-4831-9efe-9578a9ac6336', 'volume_size': 1} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:50:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1581703687',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6134fadb-39bb-4831-9efe-9578a9ac6336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5774ad8f35f34f31837017cf2701a3e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:50:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:50:24Z,use_quota=True,user_id='2bb32b12ffbc4b639ba50d0278133c89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Creating volume 6134fadb-39bb-4831-9efe-9578a9ac6336 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:50:24 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6134fadb-39bb-4831-9efe-9578a9ac6336 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:24 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6134fadb-39bb-4831-9efe-9578a9ac6336 1073741824 Sep 29 18:50:24 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:24 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f54a6c1-bf82-403f-891d-4d810f1e0c53_0f_vpq5e" returned: 1 in 0.347s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2f54a6c1-bf82-403f-891d-4d810f1e0c53_0f_vpq5e' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b27cc8d-c08e-42d0-9e66-73c47df828bc]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:24 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD Sep 29 18:50:24 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:24 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] 2f54a6c1-bf82-403f-891d-4d810f1e0c53 was qcow2, converting to qcow2 {{(pid=86523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:24 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6134fadb-39bb-4831-9efe-9578a9ac6336 1073741824" returned: 0 in 0.433s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:24 devstack sudo[102315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 Sep 29 18:50:24 devstack sudo[102315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6134fadb-39bb-4831-9efe-9578a9ac6336 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:24 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6134fadb-39bb-4831-9efe-9578a9ac6336 Sep 29 18:50:24 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:24 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6134fadb-39bb-4831-9efe-9578a9ac6336" returned: 0 in 0.247s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3f1fc32-507e-4e00-bd05-280fa5ace6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6134fadb-39bb-4831-9efe-9578a9ac6336', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d24e33-cfb0-452c-ab89-21f0d894a65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:25 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Volume volume-6134fadb-39bb-4831-9efe-9578a9ac6336 (6134fadb-39bb-4831-9efe-9578a9ac6336): created successfully Sep 29 18:50:25 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9d24e33-cfb0-452c-ab89-21f0d894a65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:25 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Flow 'volume_create_manager' (df065e34-ca18-499f-8d12-27a7be464fa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:25 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-92fcad38-6e3b-4277-a9a4-4bd83bd273ee tempest-ProjectReaderTests-1288260622 None] Created volume successfully. Sep 29 18:50:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Acquiring lock "cinder-6134fadb-39bb-4831-9efe-9578a9ac6336-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:50:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Lock "cinder-6134fadb-39bb-4831-9efe-9578a9ac6336-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:50:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Acquiring lock "cinder-quobyte-6134fadb-39bb-4831-9efe-9578a9ac6336" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:50:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Lock "cinder-quobyte-6134fadb-39bb-4831-9efe-9578a9ac6336" acquired by "delete_volume" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:50:25 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9601f18f-2347-443e-8723-dd1e139402a3]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:50:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6134fadb-39bb-4831-9efe-9578a9ac6336 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:25 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6134fadb-39bb-4831-9efe-9578a9ac6336 Sep 29 18:50:25 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:25 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6134fadb-39bb-4831-9efe-9578a9ac6336" returned: 0 in 0.401s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6134fadb-39bb-4831-9efe-9578a9ac6336 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:25 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6134fadb-39bb-4831-9efe-9578a9ac6336 Sep 29 18:50:25 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:25 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6134fadb-39bb-4831-9efe-9578a9ac6336" returned: 0 in 0.278s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Lock "cinder-quobyte-6134fadb-39bb-4831-9efe-9578a9ac6336" released by "delete_volume" :: held 0.728s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Created reservations ['6de27851-c1bb-4be1-aaf1-c7f74ec4df64', '2b0c15c1-32e6-47ce-bce5-d20fe8a15953', '0f756a24-70e4-46dd-ac93-9040e6476fbd', '2aa24c77-81cf-4646-9888-55bc00da3fdf'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:26 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:50:26 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:26 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.332s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:50:26 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Deleted volume successfully. Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b5962c0f-b6e8-4183-89ce-4e44f10bf2b3 tempest-ProjectReaderTests-1288260622 None] Lock "cinder-6134fadb-39bb-4831-9efe-9578a9ac6336-delete_volume" released by "delete_volume" :: held 1.305s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:50:26 devstack sudo[102315]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317" returned: 0 in 1.993s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2f54a6c1-bf82-403f-891d-4d810f1e0c53_07so0htddevstack@QuobyteHD, size 112.00 MB, duration 1.99 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:50:26 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Converted 112.00 MB image at 56.16 MB/s Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:26 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 1G Sep 29 18:50:26 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:26 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 1G" returned: 0 in 0.332s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Downloaded image 2f54a6c1-bf82-403f-891d-4d810f1e0c53 ((None, [{'url': 'file:///opt/stack/data/glance/images/2f54a6c1-bf82-403f-891d-4d810f1e0c53', 'metadata': {}}])) to volume a36bcdab-268f-4edf-b7a6-ea96a38f8317 successfully. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Temporary image 2f54a6c1-bf82-403f-891d-4d810f1e0c53 for user bade2050d8854611b474d74b36958bbc is deleted. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:50:26 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Marking volume a36bcdab-268f-4edf-b7a6-ea96a38f8317 as bootable. {{(pid=86523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:50:27 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Copying metadata from image 2f54a6c1-bf82-403f-891d-4d810f1e0c53 to a36bcdab-268f-4edf-b7a6-ea96a38f8317. {{(pid=86523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:50:27 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Creating volume glance metadata for volume a36bcdab-268f-4edf-b7a6-ea96a38f8317 backed by image 2f54a6c1-bf82-403f-891d-4d810f1e0c53 with: {'image_id': '2f54a6c1-bf82-403f-891d-4d810f1e0c53', 'image_name': 'tempest-scenario-img--1837955583', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:50:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b312520-4347-4887-9ff2-0c0f4246ff38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317', 'volume_size': 1, 'image_id': '2f54a6c1-bf82-403f-891d-4d810f1e0c53', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2f54a6c1-bf82-403f-891d-4d810f1e0c53', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1837955583', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '8b95ad75aa16479a9537d52a468515ac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2f54a6c1-bf82-403f-891d-4d810f1e0c53', 'created_at': datetime.datetime(2026, 9, 29, 16, 50, 14, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 50, 16, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2f54a6c1-bf82-403f-891d-4d810f1e0c53/file', 'properties': {}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c08023-21e9-4cbb-abfc-6fb2bcdb4269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:50:27 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Volume volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 (a36bcdab-268f-4edf-b7a6-ea96a38f8317): created successfully Sep 29 18:50:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0c08023-21e9-4cbb-abfc-6fb2bcdb4269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:50:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Flow 'volume_create_manager' (e0931dab-4f8e-4037-9978-6713acd2ed12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:50:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-838846a6-489b-4456-8067-29b53019b53a tempest-TestInstancesWithCinderVolumes-1932414750 None] Created volume successfully. Sep 29 18:50:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-15997ec2-7306-486b-b27f-e3c38f456bdc req-96041cad-1338-4b23-a740-9e1fbaa881d6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-15997ec2-7306-486b-b27f-e3c38f456bdc req-96041cad-1338-4b23-a740-9e1fbaa881d6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-15997ec2-7306-486b-b27f-e3c38f456bdc req-96041cad-1338-4b23-a740-9e1fbaa881d6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-15997ec2-7306-486b-b27f-e3c38f456bdc req-96041cad-1338-4b23-a740-9e1fbaa881d6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5e7602ba-0b97-4f97-b22e-bcb6eb4fb305', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:50:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-15997ec2-7306-486b-b27f-e3c38f456bdc req-96041cad-1338-4b23-a740-9e1fbaa881d6 tempest-TestInstancesWithCinderVolumes-1932414750 None] attachment_update completed successfully. Sep 29 18:50:40 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=47,cinder:UPDATE=55,cinder:INSERT=17,cinder:DELETE=7 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:50:40 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=45,cinder:UPDATE=57,cinder:INSERT=15,cinder:DELETE=4 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:50:51 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:50:51 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:50:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:50:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:50:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:50:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:50:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:50:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:50:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:50:58 devstack sudo[102900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:50:58 devstack sudo[102900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:50:58 devstack sudo[102900]: pam_unix(sudo:session): session closed for user root Sep 29 18:50:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.248s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:50:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:50:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:50:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:50:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:51:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-883981b4-2ce9-4555-a523-28343866ba69 req-58ff2594-2276-4b24-8ab1-afebcb1bf40b tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:51:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-883981b4-2ce9-4555-a523-28343866ba69 req-58ff2594-2276-4b24-8ab1-afebcb1bf40b tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:51:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-883981b4-2ce9-4555-a523-28343866ba69 req-58ff2594-2276-4b24-8ab1-afebcb1bf40b tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:51:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-883981b4-2ce9-4555-a523-28343866ba69 req-58ff2594-2276-4b24-8ab1-afebcb1bf40b tempest-TestInstancesWithCinderVolumes-1932414750 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6aba4161-f6b9-4dde-9024-16a3baf52767', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:51:01 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-883981b4-2ce9-4555-a523-28343866ba69 req-58ff2594-2276-4b24-8ab1-afebcb1bf40b tempest-TestInstancesWithCinderVolumes-1932414750 None] attachment_update completed successfully. Sep 29 18:51:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-c37ec603-bccb-45b6-813e-0e03290ce8da req-291790b0-f8d2-4058-9297-55c9095e8667 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:51:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-c37ec603-bccb-45b6-813e-0e03290ce8da req-291790b0-f8d2-4058-9297-55c9095e8667 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:51:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-c37ec603-bccb-45b6-813e-0e03290ce8da req-291790b0-f8d2-4058-9297-55c9095e8667 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:51:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-c37ec603-bccb-45b6-813e-0e03290ce8da req-291790b0-f8d2-4058-9297-55c9095e8667 tempest-TestInstancesWithCinderVolumes-1932414750 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-e66ddd3d-d620-4573-94ea-c2c657e695b6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2d00330e-bc30-421a-9878-727330156075', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:51:03 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-c37ec603-bccb-45b6-813e-0e03290ce8da req-291790b0-f8d2-4058-9297-55c9095e8667 tempest-TestInstancesWithCinderVolumes-1932414750 None] attachment_update completed successfully. Sep 29 18:51:07 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-7e528e53-cd5a-4052-80ff-20f67d8590c3 req-be5dfdf0-b819-45ec-b32e-936529e8b4be tempest-TestInstancesWithCinderVolumes-1932414750 None] Terminate volume connection completed successfully. Sep 29 18:51:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-7e528e53-cd5a-4052-80ff-20f67d8590c3 req-be5dfdf0-b819-45ec-b32e-936529e8b4be tempest-TestInstancesWithCinderVolumes-1932414750 None] Deleting attachment 6aba4161-f6b9-4dde-9024-16a3baf52767. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:51:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "cinder-aad2637a-3c93-4b08-8b37-fc1d784d10f5-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:51:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "cinder-aad2637a-3c93-4b08-8b37-fc1d784d10f5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:51:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "cinder-quobyte-aad2637a-3c93-4b08-8b37-fc1d784d10f5" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:51:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "cinder-quobyte-aad2637a-3c93-4b08-8b37-fc1d784d10f5" acquired by "delete_volume" :: waited 0.014s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:51:08 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4624f163-a9a8-4ea9-96af-df51f9c578ce]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:51:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:51:08 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5 Sep 29 18:51:08 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:51:09 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5" returned: 0 in 0.385s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:51:09 devstack sudo[103039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5 Sep 29 18:51:09 devstack sudo[103039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:51:09 devstack sudo[103039]: pam_unix(sudo:session): session closed for user root Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aad2637a-3c93-4b08-8b37-fc1d784d10f5" returned: 0 in 0.255s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "cinder-quobyte-aad2637a-3c93-4b08-8b37-fc1d784d10f5" released by "delete_volume" :: held 0.686s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:51:09 devstack cinder-volume[86523]: WARNING cinder.quota [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-611014798-823728079 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-611014798-823728079, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:51:09 devstack cinder-volume[86523]: WARNING cinder.quota [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-611014798-823728079 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-611014798-823728079, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Created reservations ['ec777c5f-91bc-41fe-b6a7-c52201846185', 'ef006a19-cb15-4c49-b8c4-bc07c92b9a6b', '40c5820f-0524-432f-bc9f-4b13e7db4427', 'c8989fe1-08af-4aae-9d4b-f3e3e4023ff6'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:51:09 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:51:09 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:51:09 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.274s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:51:09 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Deleted volume successfully. Sep 29 18:51:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3378eda0-ae70-424a-b457-83b40d619998 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "cinder-aad2637a-3c93-4b08-8b37-fc1d784d10f5-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:51:12 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-55e7f0d6-3630-4378-826a-7e9ba1273a02 req-86835ee7-4595-4c89-ba50-6dbdb4950b40 tempest-TestInstancesWithCinderVolumes-1932414750 None] Terminate volume connection completed successfully. Sep 29 18:51:12 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-55e7f0d6-3630-4378-826a-7e9ba1273a02 req-86835ee7-4595-4c89-ba50-6dbdb4950b40 tempest-TestInstancesWithCinderVolumes-1932414750 None] Deleting attachment 2d00330e-bc30-421a-9878-727330156075. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:51:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "cinder-e66ddd3d-d620-4573-94ea-c2c657e695b6-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:51:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "cinder-e66ddd3d-d620-4573-94ea-c2c657e695b6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:51:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "cinder-quobyte-e66ddd3d-d620-4573-94ea-c2c657e695b6" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:51:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "cinder-quobyte-e66ddd3d-d620-4573-94ea-c2c657e695b6" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:51:12 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5efab6a-1505-4891-be12-0739900a8197]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:51:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e66ddd3d-d620-4573-94ea-c2c657e695b6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:51:12 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e66ddd3d-d620-4573-94ea-c2c657e695b6 Sep 29 18:51:12 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:51:13 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e66ddd3d-d620-4573-94ea-c2c657e695b6" returned: 0 in 0.391s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e66ddd3d-d620-4573-94ea-c2c657e695b6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:51:13 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e66ddd3d-d620-4573-94ea-c2c657e695b6 Sep 29 18:51:13 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:51:13 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e66ddd3d-d620-4573-94ea-c2c657e695b6" returned: 0 in 0.263s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "cinder-quobyte-e66ddd3d-d620-4573-94ea-c2c657e695b6" released by "delete_volume" :: held 0.701s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:51:13 devstack cinder-volume[86523]: WARNING cinder.quota [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763973534-185238535 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763973534-185238535, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:51:13 devstack cinder-volume[86523]: WARNING cinder.quota [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763973534-185238535 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-763973534-185238535, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Created reservations ['3eb80574-6ddc-4b7c-a4a5-49d1345ef847', 'a74ac3b5-5963-47b2-8aa1-5f26c8e8981e', 'f03d96fa-e80b-41fe-abfd-dc0b13b0f277', '66133f0a-688e-4cef-a526-0cd5df0c4d09'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:51:13 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:51:13 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:51:13 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.280s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:51:13 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Deleted volume successfully. Sep 29 18:51:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e573ee50-2919-4021-871f-ca4770f271b6 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "cinder-e66ddd3d-d620-4573-94ea-c2c657e695b6-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:51:16 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-043f427b-28d5-4d82-875d-452213ee80fa req-0e34c422-e2f1-4b47-aa86-e5bdad28cb4f tempest-TestInstancesWithCinderVolumes-1932414750 None] Terminate volume connection completed successfully. Sep 29 18:51:16 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-043f427b-28d5-4d82-875d-452213ee80fa req-0e34c422-e2f1-4b47-aa86-e5bdad28cb4f tempest-TestInstancesWithCinderVolumes-1932414750 None] Deleting attachment 5e7602ba-0b97-4f97-b22e-bcb6eb4fb305. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:51:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "cinder-a36bcdab-268f-4edf-b7a6-ea96a38f8317-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:51:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "cinder-a36bcdab-268f-4edf-b7a6-ea96a38f8317-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:51:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "cinder-quobyte-a36bcdab-268f-4edf-b7a6-ea96a38f8317" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:51:17 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "cinder-quobyte-a36bcdab-268f-4edf-b7a6-ea96a38f8317" acquired by "delete_volume" :: waited 0.014s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:51:17 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4077d4da-7851-4a2e-93ed-d46b4cc8900d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:51:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:51:17 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 Sep 29 18:51:17 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:51:17 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Sep 29 18:51:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317" returned: 0 in 0.347s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:51:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:51:17 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317 Sep 29 18:51:17 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:51:18 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 29 18:51:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a36bcdab-268f-4edf-b7a6-ea96a38f8317" returned: 0 in 0.241s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:51:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "cinder-quobyte-a36bcdab-268f-4edf-b7a6-ea96a38f8317" released by "delete_volume" :: held 0.627s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:51:18 devstack cinder-volume[86523]: WARNING cinder.quota [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1774133983-1048561554 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1774133983-1048561554, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:51:18 devstack cinder-volume[86523]: WARNING cinder.quota [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1774133983-1048561554 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1774133983-1048561554, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:51:18 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Created reservations ['8ead03b3-5f02-4a89-93f8-c31735802366', 'f573c443-5f38-425c-b08c-cc15ff76f502', 'eb29c523-fcbf-4a94-afcf-41c1d3ba15c7', 'c6beb48a-3df7-4ce4-b9bc-f1ecd4f4b5a7'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:51:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:51:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:51:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:51:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:51:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:51:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:51:18 devstack sudo[103122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:51:18 devstack sudo[103122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:51:18 devstack sudo[103122]: pam_unix(sudo:session): session closed for user root Sep 29 18:51:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.243s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:51:18 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:51:18 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Deleted volume successfully. Sep 29 18:51:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5c05f44d-2c2a-458b-924d-baa5a65f4586 tempest-TestInstancesWithCinderVolumes-1932414750 None] Lock "cinder-a36bcdab-268f-4edf-b7a6-ea96a38f8317-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:51:28 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=38,cinder:UPDATE=26,cinder:INSERT=6 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:51:28 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=24,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:51:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:51:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:51:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:51:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:51:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:51:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:51:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:51:58 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:51:58 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:51:58 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Sep 29 18:51:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.288s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:51:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:51:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:51:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:51:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Flow 'volume_create_manager' (6051d645-e1e7-4a9f-8635-d0b2b6db2f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0b83c9-65fb-430d-93ba-538b7faf7a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f0b83c9-65fb-430d-93ba-538b7faf7a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-821486823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ee524c-b588-4ba4-8b2b-1583ea12e551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7716cb3b52db4468a4a808a8d73c1787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:52:20Z,use_quota=True,user_id='95abb08f68964c909e83e51d466ebcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89c69b7-fff5-40c5-aebf-fdc3dbf017d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89c69b7-fff5-40c5-aebf-fdc3dbf017d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f62532e-2653-45d2-bb44-5a10fc0c6316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f62532e-2653-45d2-bb44-5a10fc0c6316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97ee524c-b588-4ba4-8b2b-1583ea12e551', 'volume_name': 'volume-97ee524c-b588-4ba4-8b2b-1583ea12e551', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9acb157-79a5-46c6-9f48-5a39b714e171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9acb157-79a5-46c6-9f48-5a39b714e171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c8807f-2e13-4172-9885-462d6b589d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:52:20 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Volume 97ee524c-b588-4ba4-8b2b-1583ea12e551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97ee524c-b588-4ba4-8b2b-1583ea12e551', 'volume_size': 1} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-821486823',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97ee524c-b588-4ba4-8b2b-1583ea12e551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7716cb3b52db4468a4a808a8d73c1787',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:52:20Z,use_quota=True,user_id='95abb08f68964c909e83e51d466ebcf8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Creating volume 97ee524c-b588-4ba4-8b2b-1583ea12e551 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:52:20 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97ee524c-b588-4ba4-8b2b-1583ea12e551 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:52:20 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97ee524c-b588-4ba4-8b2b-1583ea12e551 1073741824 Sep 29 18:52:20 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:52:20 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97ee524c-b588-4ba4-8b2b-1583ea12e551 1073741824" returned: 0 in 0.411s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:52:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97ee524c-b588-4ba4-8b2b-1583ea12e551 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:52:20 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97ee524c-b588-4ba4-8b2b-1583ea12e551 Sep 29 18:52:20 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:52:21 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Sep 29 18:52:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97ee524c-b588-4ba4-8b2b-1583ea12e551" returned: 0 in 0.250s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:52:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] <== create_volume: return (703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:52:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:52:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25c8807f-2e13-4172-9885-462d6b589d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97ee524c-b588-4ba4-8b2b-1583ea12e551', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:52:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865037ad-ed54-4712-a8d7-c7938238b7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:52:21 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Volume volume-97ee524c-b588-4ba4-8b2b-1583ea12e551 (97ee524c-b588-4ba4-8b2b-1583ea12e551): created successfully Sep 29 18:52:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (865037ad-ed54-4712-a8d7-c7938238b7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:52:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Flow 'volume_create_manager' (6051d645-e1e7-4a9f-8635-d0b2b6db2f72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:52:21 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d26b619b-390c-4476-8f8e-7c2ad3dd1f61 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Created volume successfully. Sep 29 18:52:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-2928a58e-f249-4c8f-a6ae-a733f95cbfe9 req-ea90c271-8bcb-491a-8c57-1873024773f8 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:52:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-2928a58e-f249-4c8f-a6ae-a733f95cbfe9 req-ea90c271-8bcb-491a-8c57-1873024773f8 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:52:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-2928a58e-f249-4c8f-a6ae-a733f95cbfe9 req-ea90c271-8bcb-491a-8c57-1873024773f8 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:52:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-2928a58e-f249-4c8f-a6ae-a733f95cbfe9 req-ea90c271-8bcb-491a-8c57-1873024773f8 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-97ee524c-b588-4ba4-8b2b-1583ea12e551', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1786d505-b164-4260-9f75-b7aba5a0d83e', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:52:22 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-2928a58e-f249-4c8f-a6ae-a733f95cbfe9 req-ea90c271-8bcb-491a-8c57-1873024773f8 tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] attachment_update completed successfully. Sep 29 18:52:25 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-3b0acd69-a211-43fe-b08e-d33aa69ca426 req-84da62f0-46a7-4064-879e-38366a923b7b tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Terminate volume connection completed successfully. Sep 29 18:52:25 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-3b0acd69-a211-43fe-b08e-d33aa69ca426 req-84da62f0-46a7-4064-879e-38366a923b7b tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Deleting attachment 1786d505-b164-4260-9f75-b7aba5a0d83e. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:52:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Acquiring lock "cinder-97ee524c-b588-4ba4-8b2b-1583ea12e551-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:52:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Lock "cinder-97ee524c-b588-4ba4-8b2b-1583ea12e551-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:52:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Acquiring lock "cinder-quobyte-97ee524c-b588-4ba4-8b2b-1583ea12e551" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:52:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Lock "cinder-quobyte-97ee524c-b588-4ba4-8b2b-1583ea12e551" acquired by "delete_volume" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:52:25 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cd16cf-87fd-4d54-acec-cf6cfe5e8193]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:52:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97ee524c-b588-4ba4-8b2b-1583ea12e551 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:52:26 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97ee524c-b588-4ba4-8b2b-1583ea12e551 Sep 29 18:52:26 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:52:26 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Sep 29 18:52:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97ee524c-b588-4ba4-8b2b-1583ea12e551" returned: 0 in 0.360s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:52:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97ee524c-b588-4ba4-8b2b-1583ea12e551 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:52:26 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97ee524c-b588-4ba4-8b2b-1583ea12e551 Sep 29 18:52:26 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:52:26 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Sep 29 18:52:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-97ee524c-b588-4ba4-8b2b-1583ea12e551" returned: 0 in 0.260s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:52:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Lock "cinder-quobyte-97ee524c-b588-4ba4-8b2b-1583ea12e551" released by "delete_volume" :: held 0.662s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:52:26 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Created reservations ['9c008900-32cc-41ed-bbb5-bb859258a936', '684524ce-4f09-4ffd-9346-ce7cdfc327f1', 'ed76fa50-1131-4e54-b777-97baec4174aa', 'f3744924-bc57-4bbc-85b2-f34663f59a0d'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:52:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:52:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:52:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:52:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:52:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:52:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:52:26 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:52:26 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:52:26 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Sep 29 18:52:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.249s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:52:27 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:52:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Deleted volume successfully. Sep 29 18:52:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ec19f463-4266-4425-ac4e-a89dd4d94cca tempest-TestServerVolumeAttachScenarioOldVersion-1409018333 None] Lock "cinder-97ee524c-b588-4ba4-8b2b-1583ea12e551-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:52:36 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=18,cinder:UPDATE=10,cinder:INSERT=3 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:52:37 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=11,cinder:UPDATE=15,cinder:DELETE=2,cinder:INSERT=2 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:52:51 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:52:51 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:52:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:52:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:52:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:52:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:52:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:52:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:52:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:52:58 devstack sudo[103829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:52:58 devstack sudo[103829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:52:58 devstack sudo[103829]: pam_unix(sudo:session): session closed for user root Sep 29 18:52:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.257s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:52:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:52:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:52:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:52:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Flow 'volume_create_manager' (8dfd9917-9ed5-47e9-aa0a-b21a1b31fd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5dce514-5241-46b1-a3a0-d2b6cea50bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5dce514-5241-46b1-a3a0-d2b6cea50bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1059189624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452a225a-3f9c-4a55-bfcb-236eab775b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cde82c30fb4b47afd929fa8a44c37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:53:00Z,use_quota=True,user_id='1c0e6b0b7b0e47678d26b816f0b83e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7407f45-a900-4f79-9a37-a26584940d7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7407f45-a900-4f79-9a37-a26584940d7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b80299-b9d4-46c6-a478-bd66a38e5fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.image.glance [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Creating Keystone auth plugin from conf {{(pid=86523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b80299-b9d4-46c6-a478-bd66a38e5fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '452a225a-3f9c-4a55-bfcb-236eab775b5e', 'volume_name': 'volume-452a225a-3f9c-4a55-bfcb-236eab775b5e', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dfa4e1-2a31-4f65-9de9-d6ac29073408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0dfa4e1-2a31-4f65-9de9-d6ac29073408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30194c24-1047-4728-afa4-475df111f3fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:53:00 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Volume 452a225a-3f9c-4a55-bfcb-236eab775b5e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-452a225a-3f9c-4a55-bfcb-236eab775b5e', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Trying to clone 452a225a-3f9c-4a55-bfcb-236eab775b5e from image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 at location (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]). {{(pid=86523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:53:00 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Image download 20.69 MB at 20.69 MB/s Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf252554-3cd7-4021-a489-714f4a32498e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:53:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:53:01 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD Sep 29 18:53:01 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:53:01 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Temporary image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 is fetched for user 1c0e6b0b7b0e47678d26b816f0b83e02. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a234d8-99b0-4128-866e-43e56a6435d0]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:53:01 devstack sudo[103880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD Sep 29 18:53:01 devstack sudo[103880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:53:01 devstack sudo[103880]: pam_unix(sudo:session): session closed for user root Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1059189624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=452a225a-3f9c-4a55-bfcb-236eab775b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cde82c30fb4b47afd929fa8a44c37b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:53:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:53:00Z,use_quota=True,user_id='1c0e6b0b7b0e47678d26b816f0b83e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Creating volume 452a225a-3f9c-4a55-bfcb-236eab775b5e {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:53:01 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:53:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:53:01 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e 1073741824 Sep 29 18:53:01 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:53:02 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Sep 29 18:53:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e 1073741824" returned: 0 in 0.411s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:53:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:53:02 devstack sudo[103891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e Sep 29 18:53:02 devstack sudo[103891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:53:02 devstack sudo[103891]: pam_unix(sudo:session): session closed for user root Sep 29 18:53:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e" returned: 0 in 0.246s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:53:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:53:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:53:02 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Attempting download of 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 ((None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}])) to volume 452a225a-3f9c-4a55-bfcb-236eab775b5e. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:53:02 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[19892f56-b043-4e92-a991-9bd6b24331ca]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:53:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_iuoz08v7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:53:02 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_iuoz08v7 Sep 29 18:53:02 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:53:02 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Sep 29 18:53:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_iuoz08v7" returned: 0 in 0.342s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:53:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_iuoz08v7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:53:02 devstack sudo[103898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_iuoz08v7 Sep 29 18:53:02 devstack sudo[103898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:53:03 devstack sudo[103898]: pam_unix(sudo:session): session closed for user root Sep 29 18:53:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_iuoz08v7" returned: 1 in 0.346s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:53:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_iuoz08v7' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:53:03 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[04169eb3-8906-41c2-a579-24160fd50658]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:53:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:53:03 devstack sudo[103902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD Sep 29 18:53:03 devstack sudo[103902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:53:03 devstack sudo[103902]: pam_unix(sudo:session): session closed for user root Sep 29 18:53:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:53:03 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 was qcow2, converting to qcow2 {{(pid=86523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:53:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:53:03 devstack sudo[103909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e Sep 29 18:53:03 devstack sudo[103909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:53:05 devstack sudo[103909]: pam_unix(sudo:session): session closed for user root Sep 29 18:53:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e" returned: 0 in 1.731s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:53:05 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948_em5uq2zldevstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:53:05 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Converted 112.00 MB image at 64.64 MB/s Sep 29 18:53:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:53:05 devstack sudo[103918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e 1G Sep 29 18:53:05 devstack sudo[103918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:53:05 devstack sudo[103918]: pam_unix(sudo:session): session closed for user root Sep 29 18:53:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e 1G" returned: 0 in 0.307s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:53:05 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Downloaded image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 ((None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}])) to volume 452a225a-3f9c-4a55-bfcb-236eab775b5e successfully. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:53:05 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Temporary image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 for user 1c0e6b0b7b0e47678d26b816f0b83e02 is deleted. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:53:05 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Marking volume 452a225a-3f9c-4a55-bfcb-236eab775b5e as bootable. {{(pid=86523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:53:05 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Copying metadata from image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 to 452a225a-3f9c-4a55-bfcb-236eab775b5e. {{(pid=86523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:53:05 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Creating volume glance metadata for volume 452a225a-3f9c-4a55-bfcb-236eab775b5e backed by image 90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:53:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30194c24-1047-4728-afa4-475df111f3fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-452a225a-3f9c-4a55-bfcb-236eab775b5e', 'volume_size': 1, 'image_id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'bc6f2dadccb041a8aad132fced9a2480', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948', 'created_at': datetime.datetime(2026, 9, 29, 16, 30, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 30, 5, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/90d3bc57-0a5e-4b3f-ad3f-dc7b91c30948/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:53:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d21eca-d9ab-4664-83f8-d167e7d4d061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:53:05 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Volume volume-452a225a-3f9c-4a55-bfcb-236eab775b5e (452a225a-3f9c-4a55-bfcb-236eab775b5e): created successfully Sep 29 18:53:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68d21eca-d9ab-4664-83f8-d167e7d4d061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:53:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Flow 'volume_create_manager' (8dfd9917-9ed5-47e9-aa0a-b21a1b31fd72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:53:05 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-181d994a-93e4-404b-9db6-b4d3f571949f tempest-TestShelveInstance-105257264 None] Created volume successfully. Sep 29 18:53:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-4a68770d-3156-4b42-a2dd-08323aff2450 req-a679de2e-46df-4682-8e74-ff48fe52ef57 tempest-TestShelveInstance-105257264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:53:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-4a68770d-3156-4b42-a2dd-08323aff2450 req-a679de2e-46df-4682-8e74-ff48fe52ef57 tempest-TestShelveInstance-105257264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:53:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-4a68770d-3156-4b42-a2dd-08323aff2450 req-a679de2e-46df-4682-8e74-ff48fe52ef57 tempest-TestShelveInstance-105257264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:53:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-4a68770d-3156-4b42-a2dd-08323aff2450 req-a679de2e-46df-4682-8e74-ff48fe52ef57 tempest-TestShelveInstance-105257264 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-452a225a-3f9c-4a55-bfcb-236eab775b5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69b322ca-13df-4c9f-aa1f-c30fa1abca7e', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:53:09 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-4a68770d-3156-4b42-a2dd-08323aff2450 req-a679de2e-46df-4682-8e74-ff48fe52ef57 tempest-TestShelveInstance-105257264 None] attachment_update completed successfully. Sep 29 18:53:19 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=17,cinder:UPDATE=6,cinder:INSERT=6 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:53:19 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=15,cinder:UPDATE=6,cinder:INSERT=8,cinder:DELETE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:53:41 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-0b08226b-266b-48f6-b16e-eb14c85fc45e req-71a63541-f0a0-4b27-bcce-28a00fa4aa3b tempest-TestShelveInstance-105257264 None] Terminate volume connection completed successfully. Sep 29 18:53:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-0b08226b-266b-48f6-b16e-eb14c85fc45e req-71a63541-f0a0-4b27-bcce-28a00fa4aa3b tempest-TestShelveInstance-105257264 None] Deleting attachment 69b322ca-13df-4c9f-aa1f-c30fa1abca7e. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:53:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-fe220a72-5a8a-4da9-a13e-ccfd3d0b8ef7 req-d211a89d-6aec-40e7-ba76-39f90b886bd3 tempest-TestShelveInstance-105257264 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:53:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-fe220a72-5a8a-4da9-a13e-ccfd3d0b8ef7 req-d211a89d-6aec-40e7-ba76-39f90b886bd3 tempest-TestShelveInstance-105257264 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:53:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-fe220a72-5a8a-4da9-a13e-ccfd3d0b8ef7 req-d211a89d-6aec-40e7-ba76-39f90b886bd3 tempest-TestShelveInstance-105257264 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:53:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-fe220a72-5a8a-4da9-a13e-ccfd3d0b8ef7 req-d211a89d-6aec-40e7-ba76-39f90b886bd3 tempest-TestShelveInstance-105257264 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-452a225a-3f9c-4a55-bfcb-236eab775b5e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bb45f12e-2dc2-4968-8672-a7e9c7a8030b', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:53:44 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-fe220a72-5a8a-4da9-a13e-ccfd3d0b8ef7 req-d211a89d-6aec-40e7-ba76-39f90b886bd3 tempest-TestShelveInstance-105257264 None] attachment_update completed successfully. Sep 29 18:53:54 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:53:54 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:53:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:53:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:53:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:53:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:53:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:53:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:53:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:53:58 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:53:58 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:53:58 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Sep 29 18:53:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.247s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:53:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:53:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:53:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:53:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:54:14 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-ad21d402-081e-4756-b5d3-b7030ff373b2 tempest-TestShelveInstance-105257264 None] Terminate volume connection completed successfully. Sep 29 18:54:14 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-ad21d402-081e-4756-b5d3-b7030ff373b2 tempest-TestShelveInstance-105257264 None] Deleting attachment bb45f12e-2dc2-4968-8672-a7e9c7a8030b. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:54:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Acquiring lock "cinder-452a225a-3f9c-4a55-bfcb-236eab775b5e-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:54:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Lock "cinder-452a225a-3f9c-4a55-bfcb-236eab775b5e-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:54:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Acquiring lock "cinder-quobyte-452a225a-3f9c-4a55-bfcb-236eab775b5e" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:54:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Lock "cinder-quobyte-452a225a-3f9c-4a55-bfcb-236eab775b5e" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:54:14 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6402464-050f-4267-b4a0-93593a5d96dd]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:54:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:54:14 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e Sep 29 18:54:14 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:54:15 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e" returned: 0 in 0.389s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:54:15 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e Sep 29 18:54:15 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:54:15 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-452a225a-3f9c-4a55-bfcb-236eab775b5e" returned: 0 in 0.253s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Lock "cinder-quobyte-452a225a-3f9c-4a55-bfcb-236eab775b5e" released by "delete_volume" :: held 0.687s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG cinder.quota [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Created reservations ['4f5fcde0-a545-4aff-8e2d-f07abd09791d', 'd60f8de1-2853-4f66-8dc6-76e7c6679633', 'eb41b539-d438-4385-8d6a-7c667a09bc4a', '0b6241f6-3cd7-4960-8202-2644d3b371b5'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:54:15 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:54:15 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:54:15 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.253s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG cinder.manager [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:54:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Deleted volume successfully. Sep 29 18:54:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [req-f7781edd-2e22-4cab-b7b0-e1fa29577790 req-45d676f4-000e-4f85-81cd-dea4793a2b6e tempest-TestShelveInstance-105257264 None] Lock "cinder-452a225a-3f9c-4a55-bfcb-236eab775b5e-delete_volume" released by "delete_volume" :: held 1.137s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:54:25 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=7,cinder:INSERT=2,cinder:UPDATE=8 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:54:25 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=8,cinder:SELECT=5,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Flow 'volume_create_manager' (2a49324b-0d75-4280-9787-117b86b8783b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b7d58d-96e1-44c5-b65c-8fa9afbe00e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56b7d58d-96e1-44c5-b65c-8fa9afbe00e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-543695580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc97aca-5088-4bb6-921c-18925c7acbd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f259e7e147474e8187127609cc2cf44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:54:46Z,use_quota=True,user_id='a485a3cd509c4e54a52ddc96a35e50d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c861eb64-dde2-4093-afde-ef8d6a2d0d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c861eb64-dde2-4093-afde-ef8d6a2d0d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe576841-d29a-4ab6-a160-9cfc61e3ac18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe576841-d29a-4ab6-a160-9cfc61e3ac18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffc97aca-5088-4bb6-921c-18925c7acbd6', 'volume_name': 'volume-ffc97aca-5088-4bb6-921c-18925c7acbd6', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631974c9-6eda-410d-adb3-d5304c2f4c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (631974c9-6eda-410d-adb3-d5304c2f4c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b561284-a050-4397-baeb-06da9cd85901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:54:45 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Volume ffc97aca-5088-4bb6-921c-18925c7acbd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffc97aca-5088-4bb6-921c-18925c7acbd6', 'volume_size': 1} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:54:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-543695580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffc97aca-5088-4bb6-921c-18925c7acbd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f259e7e147474e8187127609cc2cf44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:54:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:54:46Z,use_quota=True,user_id='a485a3cd509c4e54a52ddc96a35e50d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Creating volume ffc97aca-5088-4bb6-921c-18925c7acbd6 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:54:45 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:54:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:54:45 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 1073741824 Sep 29 18:54:45 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:54:46 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Sep 29 18:54:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 1073741824" returned: 0 in 0.466s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:54:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:54:46 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 Sep 29 18:54:46 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:54:46 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Sep 29 18:54:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6" returned: 0 in 0.252s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:54:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:54:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:54:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b561284-a050-4397-baeb-06da9cd85901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffc97aca-5088-4bb6-921c-18925c7acbd6', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:54:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1187b9-8ab4-4576-ae88-7e889a29681d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:54:46 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Volume volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 (ffc97aca-5088-4bb6-921c-18925c7acbd6): created successfully Sep 29 18:54:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd1187b9-8ab4-4576-ae88-7e889a29681d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:54:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Flow 'volume_create_manager' (2a49324b-0d75-4280-9787-117b86b8783b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:54:46 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-44c10c9c-27c4-4792-9828-8b7f9c5e9f30 tempest-TestStampPattern-260198039 None] Created volume successfully. Sep 29 18:54:56 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=3,cinder:UPDATE=4 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:54:56 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=3,cinder:SELECT=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:54:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:54:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:54:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:54:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:54:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:54:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:54:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:54:58 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:54:58 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:54:58 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 29 18:54:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.273s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:54:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:54:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:54:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:54:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:55:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-639371cd-f446-47ae-8d18-00b4626c81f2 req-0e224ac1-bae0-4752-b015-7eecb93270cd tempest-TestStampPattern-260198039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:55:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-639371cd-f446-47ae-8d18-00b4626c81f2 req-0e224ac1-bae0-4752-b015-7eecb93270cd tempest-TestStampPattern-260198039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:55:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-639371cd-f446-47ae-8d18-00b4626c81f2 req-0e224ac1-bae0-4752-b015-7eecb93270cd tempest-TestStampPattern-260198039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:55:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-639371cd-f446-47ae-8d18-00b4626c81f2 req-0e224ac1-bae0-4752-b015-7eecb93270cd tempest-TestStampPattern-260198039 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-ffc97aca-5088-4bb6-921c-18925c7acbd6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ecc6d5a-7a83-4be5-b4b0-caac42e5a049', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:55:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-639371cd-f446-47ae-8d18-00b4626c81f2 req-0e224ac1-bae0-4752-b015-7eecb93270cd tempest-TestStampPattern-260198039 None] attachment_update completed successfully. Sep 29 18:55:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-6fdac7e2-a794-4480-8cb7-68267a86ac44 req-dd91673f-27d8-45ac-ad53-7fa845047a73 tempest-TestStampPattern-260198039 None] Terminate volume connection completed successfully. Sep 29 18:55:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-6fdac7e2-a794-4480-8cb7-68267a86ac44 req-dd91673f-27d8-45ac-ad53-7fa845047a73 tempest-TestStampPattern-260198039 None] Deleting attachment 9ecc6d5a-7a83-4be5-b4b0-caac42e5a049. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:55:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:55:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:55:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] Creating offline snapshot 1cb816d4-e106-4327-be4e-e132cff7faab of volume ffc97aca-5088-4bb6-921c-18925c7acbd6 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:55:21 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f95ba3b3-357c-4437-b02e-63550b4fb228]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:55:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:55:21 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 Sep 29 18:55:21 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:55:21 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Sep 29 18:55:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6" returned: 0 in 0.356s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:55:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:55:21 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab 1G Sep 29 18:55:21 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:55:21 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Sep 29 18:55:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab 1G" returned: 0 in 0.389s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:55:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:55:22 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab Sep 29 18:55:22 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:55:22 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 29 18:55:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab" returned: 0 in 0.303s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:55:22 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab is being set with open permissions: ugo+rw Sep 29 18:55:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:55:22 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab Sep 29 18:55:22 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:55:22 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 29 18:55:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab" returned: 0 in 0.242s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:55:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:55:22 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.info Sep 29 18:55:22 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:55:22 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 29 18:55:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.info" returned: 0 in 0.257s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:55:22 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.info is being set with open permissions: ugo+rw Sep 29 18:55:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:55:22 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.info Sep 29 18:55:22 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:55:23 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 29 18:55:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.info" returned: 0 in 0.250s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:55:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.889s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:55:23 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4e403c01-e9e4-4ee6-9082-43d7ce049d7e tempest-TestStampPattern-260198039 None] Create snapshot completed successfully Sep 29 18:55:29 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:55:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Flow 'volume_create_manager' (4ea6b7a2-9ceb-4f72-a356-670acc08b5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:55:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b354263-ff8f-4232-bb59-76178546a423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b354263-ff8f-4232-bb59-76178546a423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:55:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-19852950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eca56404-26b0-4a47-b56a-b546893036d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f259e7e147474e8187127609cc2cf44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:55:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1cb816d4-e106-4327-be4e-e132cff7faab,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:55:30Z,use_quota=True,user_id='a485a3cd509c4e54a52ddc96a35e50d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edaab26-0226-4287-874a-88feec32b228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8edaab26-0226-4287-874a-88feec32b228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4fc889-fa70-4822-ada2-6c2231b0443f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e4fc889-fa70-4822-ada2-6c2231b0443f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'eca56404-26b0-4a47-b56a-b546893036d8', 'volume_name': 'volume-eca56404-26b0-4a47-b56a-b546893036d8', 'volume_size': 1, 'snapshot_id': '1cb816d4-e106-4327-be4e-e132cff7faab'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80910acf-53f4-4902-bb96-f462fd58d514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80910acf-53f4-4902-bb96-f462fd58d514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4918b6-5bee-4653-9507-32c2d926ad81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:55:30 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Volume eca56404-26b0-4a47-b56a-b546893036d8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-eca56404-26b0-4a47-b56a-b546893036d8', 'volume_size': 1, 'snapshot_id': '1cb816d4-e106-4327-be4e-e132cff7faab'} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Acquiring lock "cinder-quobyte-1cb816d4-e106-4327-be4e-e132cff7faab-eca56404-26b0-4a47-b56a-b546893036d8" by "_create_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Lock "cinder-quobyte-1cb816d4-e106-4327-be4e-e132cff7faab-eca56404-26b0-4a47-b56a-b546893036d8" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Creating volume eca56404-26b0-4a47-b56a-b546893036d8 from snapshot 1cb816d4-e106-4327-be4e-e132cff7faab {{(pid=86523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Acquiring lock "cinder-quobyte-eca56404-26b0-4a47-b56a-b546893036d8" by "_copy_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Lock "cinder-quobyte-eca56404-26b0-4a47-b56a-b546893036d8" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] snapshot: 1cb816d4-e106-4327-be4e-e132cff7faab, volume: eca56404-26b0-4a47-b56a-b546893036d8, {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9c4909-5be4-4dec-b989-04bab16095cc]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:55:30 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab Sep 29 18:55:30 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:55:30 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab" returned: 0 in 0.432s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffc97aca-5088-4bb6-921c-18925c7acbd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c68d63-7fbc-43f1-ac2d-856e38ac0911]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:55:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:55:30 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 Sep 29 18:55:30 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:55:31 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Sep 29 18:55:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6" returned: 0 in 0.389s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:55:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:55:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Creating direct copy from snapshot {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:55:31 devstack cinder-volume[86523]: DEBUG cinder.utils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Path /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8 not found in is_blk_device check {{(pid=86523) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:55:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:55:31 devstack sudo[106337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8 Sep 29 18:55:31 devstack sudo[106337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:55:39 devstack sudo[106337]: pam_unix(sudo:session): session closed for user root Sep 29 18:55:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8" returned: 0 in 8.608s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:55:39 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6, size 1024.00 MB, duration 8.61 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:55:39 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Converted 1024.00 MB image at 118.93 MB/s Sep 29 18:55:39 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8 is being set with open permissions: ugo+rw Sep 29 18:55:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:55:39 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8 Sep 29 18:55:39 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:55:39 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 29 18:55:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8" returned: 0 in 0.270s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:55:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Lock "cinder-quobyte-eca56404-26b0-4a47-b56a-b546893036d8" released by "_copy_volume_from_snapshot" :: held 9.802s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:55:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Lock "cinder-quobyte-1cb816d4-e106-4327-be4e-e132cff7faab-eca56404-26b0-4a47-b56a-b546893036d8" released by "_create_volume_from_snapshot" :: held 9.870s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:55:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.890s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:55:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc4918b6-5bee-4653-9507-32c2d926ad81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eca56404-26b0-4a47-b56a-b546893036d8', 'volume_size': 1, 'snapshot_id': '1cb816d4-e106-4327-be4e-e132cff7faab'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:55:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025a5588-3613-43a6-be1b-a009d74915bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:55:40 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Volume volume-eca56404-26b0-4a47-b56a-b546893036d8 (eca56404-26b0-4a47-b56a-b546893036d8): created successfully Sep 29 18:55:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (025a5588-3613-43a6-be1b-a009d74915bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:55:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Flow 'volume_create_manager' (4ea6b7a2-9ceb-4f72-a356-670acc08b5ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:55:40 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a5569f91-af61-499c-b0a0-a3fa5a21b28b tempest-TestStampPattern-260198039 None] Created volume successfully. Sep 29 18:55:50 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=13,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:55:50 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=16,cinder:UPDATE=5,cinder:DELETE=2 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:55:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:55:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:55:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:56:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-70096643-e7c0-4655-857c-f25ed8ecd2a5 req-a8121716-9da1-420c-997c-9da798edf526 tempest-TestStampPattern-260198039 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:56:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-70096643-e7c0-4655-857c-f25ed8ecd2a5 req-a8121716-9da1-420c-997c-9da798edf526 tempest-TestStampPattern-260198039 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:56:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [req-70096643-e7c0-4655-857c-f25ed8ecd2a5 req-a8121716-9da1-420c-997c-9da798edf526 tempest-TestStampPattern-260198039 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:56:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-70096643-e7c0-4655-857c-f25ed8ecd2a5 req-a8121716-9da1-420c-997c-9da798edf526 tempest-TestStampPattern-260198039 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da', 'name': 'volume-eca56404-26b0-4a47-b56a-b546893036d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1219d674-660c-43c0-a1c3-39060bd42553', 'enforce_multipath': True} {{(pid=86523) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4964}} Sep 29 18:56:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-70096643-e7c0-4655-857c-f25ed8ecd2a5 req-a8121716-9da1-420c-997c-9da798edf526 tempest-TestStampPattern-260198039 None] attachment_update completed successfully. Sep 29 18:56:24 devstack cinder-volume[86523]: INFO cinder.volume.manager [req-8369a6b8-ac5a-4d17-9760-7f6c2dc1bbaf req-ff264fa1-818c-43d9-a53e-be9930805adf tempest-TestStampPattern-260198039 None] Terminate volume connection completed successfully. Sep 29 18:56:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [req-8369a6b8-ac5a-4d17-9760-7f6c2dc1bbaf req-ff264fa1-818c-43d9-a53e-be9930805adf tempest-TestStampPattern-260198039 None] Deleting attachment 1219d674-660c-43c0-a1c3-39060bd42553. {{(pid=86523) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5095}} Sep 29 18:56:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Acquiring lock "cinder-eca56404-26b0-4a47-b56a-b546893036d8-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:56:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Lock "cinder-eca56404-26b0-4a47-b56a-b546893036d8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:56:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Acquiring lock "cinder-quobyte-eca56404-26b0-4a47-b56a-b546893036d8" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:56:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Lock "cinder-quobyte-eca56404-26b0-4a47-b56a-b546893036d8" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:56:28 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[102ff689-db0b-4fb2-82fa-19a29fdf3454]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:56:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:28 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8 Sep 29 18:56:28 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:28 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8" returned: 0 in 0.375s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:28 devstack sudo[107038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8 Sep 29 18:56:28 devstack sudo[107038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:28 devstack sudo[107038]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eca56404-26b0-4a47-b56a-b546893036d8" returned: 0 in 0.246s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Lock "cinder-quobyte-eca56404-26b0-4a47-b56a-b546893036d8" released by "delete_volume" :: held 0.674s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Created reservations ['b0b64510-7a47-44b7-a465-8c6cdf6a8326', '1ef683ac-1b8e-406c-8924-2e0c3cb46a24', 'bf551626-a47a-41e5-a783-ba86a0192237', '698b5ec0-4940-4761-a261-72bcd5d64b0d'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:29 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:56:29 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:29 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.250s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:56:29 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Deleted volume successfully. Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c572ada2-68a1-4012-9cd8-00d902346d15 tempest-TestStampPattern-260198039 None] Lock "cinder-eca56404-26b0-4a47-b56a-b546893036d8-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Acquiring lock "cinder-1cb816d4-e106-4327-be4e-e132cff7faab-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Lock "cinder-1cb816d4-e106-4327-be4e-e132cff7faab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Acquiring lock "cinder-quobyte-ffc97aca-5088-4bb6-921c-18925c7acbd6" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Lock "cinder-quobyte-ffc97aca-5088-4bb6-921c-18925c7acbd6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Acquiring lock "cinder-quobyte-1cb816d4-e106-4327-be4e-e132cff7faab" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Lock "cinder-quobyte-1cb816d4-e106-4327-be4e-e132cff7faab" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Deleting offline snapshot 1cb816d4-e106-4327-be4e-e132cff7faab of volume ffc97aca-5088-4bb6-921c-18925c7acbd6 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] snapshot_file for this snap is: volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdc35b1-9fbf-488c-80a6-aca4163b6a6b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:56:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:29 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab Sep 29 18:56:29 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:30 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab" returned: 0 in 0.370s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ffc97aca-5088-4bb6-921c-18925c7acbd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:56:30 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9b590b4-e363-4e23-a8c0-bc4e2add0de8]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:56:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:30 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 Sep 29 18:56:30 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:30 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6" returned: 0 in 0.550s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:30 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab Sep 29 18:56:30 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:31 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab" returned: 0 in 0.336s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:31 devstack sudo[107059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab Sep 29 18:56:31 devstack sudo[107059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:31 devstack sudo[107059]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6.1cb816d4-e106-4327-be4e-e132cff7faab" returned: 0 in 0.263s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Lock "cinder-quobyte-1cb816d4-e106-4327-be4e-e132cff7faab" released by "_delete_snapshot" :: held 1.646s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:56:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Lock "cinder-quobyte-ffc97aca-5088-4bb6-921c-18925c7acbd6" released by "delete_snapshot" :: held 1.680s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:56:31 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Created reservations ['2bf313e8-37e7-450a-abc2-4c3cbc23f03e', 'fecf395b-4bc9-4178-9f7d-fc046fcda243', 'a515be4e-d6ec-4d3c-b450-cd0a7286ec7f', 'df98ce14-f4bf-474b-aabc-9842f9ddfe6f'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:56:31 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Delete snapshot completed successfully. Sep 29 18:56:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e2fdd090-b38a-471a-b9e1-118ba8fbc234 tempest-TestStampPattern-260198039 None] Lock "cinder-1cb816d4-e106-4327-be4e-e132cff7faab-delete_snapshot" released by "delete_snapshot" :: held 1.812s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:56:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Acquiring lock "cinder-ffc97aca-5088-4bb6-921c-18925c7acbd6-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:56:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Lock "cinder-ffc97aca-5088-4bb6-921c-18925c7acbd6-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:56:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Acquiring lock "cinder-quobyte-ffc97aca-5088-4bb6-921c-18925c7acbd6" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:56:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Lock "cinder-quobyte-ffc97aca-5088-4bb6-921c-18925c7acbd6" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:56:35 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9af0fab-48db-4b91-afa5-049d6897d696]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:56:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:35 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 Sep 29 18:56:35 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:35 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6" returned: 0 in 0.365s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:35 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6 Sep 29 18:56:35 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:36 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ffc97aca-5088-4bb6-921c-18925c7acbd6" returned: 0 in 0.242s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Lock "cinder-quobyte-ffc97aca-5088-4bb6-921c-18925c7acbd6" released by "delete_volume" :: held 0.668s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:56:36 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Created reservations ['f6e05911-1f9f-4306-8b75-33f48e2453d9', 'b3c7b26c-dfcd-430c-84a0-e11649dcf2d3', '8a896b40-7715-4085-bf9c-f914dbac40a7', 'f1512353-aff4-437d-977f-dc475bec7224'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:56:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:56:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:56:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:56:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:56:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:56:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:36 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:56:36 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:36 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.249s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:36 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:56:36 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Deleted volume successfully. Sep 29 18:56:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b4852b6b-93f8-44f3-bd1f-cd493e042641 tempest-TestStampPattern-260198039 None] Lock "cinder-ffc97aca-5088-4bb6-921c-18925c7acbd6-delete_volume" released by "delete_volume" :: held 1.107s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:56:46 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=23,cinder:INSERT=6,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:56:51 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=24,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:56:51 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:56:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Flow 'volume_create_manager' (d856b788-2f10-4a83-a8b1-f07c023433a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:56:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e24db84-3530-4f3d-9d88-014d096a554a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:56:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e24db84-3530-4f3d-9d88-014d096a554a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b0c288-cb47-4c68-9026-88020f2beab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef92c4242264a299961f380e085d775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:56:52Z,use_quota=True,user_id='841e7086096448caa0f1d9bb0d18e1ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f94bb59b-4a2c-4359-a1ef-0228870c2ca3),volume_type_id=f94bb59b-4a2c-4359-a1ef-0228870c2ca3)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:56:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad7b682-c830-40db-8a13-fb90e8715988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:56:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ad7b682-c830-40db-8a13-fb90e8715988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:56:51 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a0513f-c5b5-4d25-97e3-fe5c7525899f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:56:51 devstack cinder-volume[86523]: DEBUG cinder.image.glance [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Creating Keystone auth plugin from conf {{(pid=86523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41a0513f-c5b5-4d25-97e3-fe5c7525899f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '57b0c288-cb47-4c68-9026-88020f2beab7', 'volume_name': 'volume-57b0c288-cb47-4c68-9026-88020f2beab7', 'volume_size': 1, 'image_id': '8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b723c1c29d8e4a88aec1e1c1e9be3e8e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4ef92c4242264a299961f380e085d775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ace99a05d3af8d802acddafe5b4a65140418dd732ba6c9dba7ad14a0f415c54a47a6a3de6e55b9b5b565e5d5523b66989a0d1dadbab4e4342aeea64ad007be0', 'id': '8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4', 'created_at': datetime.datetime(2026, 9, 29, 16, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fc6ea5-4276-4a95-afaa-25e7de038060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7fc6ea5-4276-4a95-afaa-25e7de038060) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328706bb-51a7-4e2b-9c52-eb5d51e1c377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:56:52 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Volume 57b0c288-cb47-4c68-9026-88020f2beab7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-57b0c288-cb47-4c68-9026-88020f2beab7', 'volume_size': 1, 'image_id': '8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b723c1c29d8e4a88aec1e1c1e9be3e8e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4ef92c4242264a299961f380e085d775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ace99a05d3af8d802acddafe5b4a65140418dd732ba6c9dba7ad14a0f415c54a47a6a3de6e55b9b5b565e5d5523b66989a0d1dadbab4e4342aeea64ad007be0', 'id': '8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4', 'created_at': datetime.datetime(2026, 9, 29, 16, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Trying to clone 57b0c288-cb47-4c68-9026-88020f2beab7 from image 8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4', 'metadata': {}}]). {{(pid=86523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:56:52 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Image download 0.00 MB at 0.00 MB/s Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[79a4f083-0b05-4efe-a59c-b8780a1b7098]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:52 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD Sep 29 18:56:52 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:52 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:52 devstack sudo[107116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD Sep 29 18:56:52 devstack sudo[107116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:52 devstack sudo[107116]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD" returned: 1 in 0.332s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Temporary image 8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4 is fetched for user 841e7086096448caa0f1d9bb0d18e1ac. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead4163f-eff6-42b3-aa49-46d157f0c357]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:56:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:53 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD Sep 29 18:56:53 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:53 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD" returned: 0 in 0.317s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:53 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD Sep 29 18:56:53 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:53 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD" returned: 1 in 0.320s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:56:51Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b0c288-cb47-4c68-9026-88020f2beab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ef92c4242264a299961f380e085d775',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:56:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:56:52Z,use_quota=True,user_id='841e7086096448caa0f1d9bb0d18e1ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f94bb59b-4a2c-4359-a1ef-0228870c2ca3),volume_type_id=f94bb59b-4a2c-4359-a1ef-0228870c2ca3)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Creating volume 57b0c288-cb47-4c68-9026-88020f2beab7 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:56:53 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:53 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 1073741824 Sep 29 18:56:53 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:53 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 1073741824" returned: 0 in 0.413s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:54 devstack sudo[107137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 Sep 29 18:56:54 devstack sudo[107137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:54 devstack sudo[107137]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7" returned: 0 in 0.255s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:56:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:56:54 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Attempting download of 8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4', 'metadata': {}}])) to volume 57b0c288-cb47-4c68-9026-88020f2beab7. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:56:54 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b186e707-0e87-41a1-ba3c-33b2a35633a1]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:56:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_bakkb399 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:54 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_bakkb399 Sep 29 18:56:54 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:54 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_bakkb399" returned: 0 in 0.324s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_bakkb399 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:54 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_bakkb399 Sep 29 18:56:54 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:54 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_bakkb399" returned: 1 in 0.328s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_bakkb399' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:56:54 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[63183ebc-9fcc-4462-b492-92ac819bd29e]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:56:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:55 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD Sep 29 18:56:55 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:55 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:55 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD Sep 29 18:56:55 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:55 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD" returned: 1 in 0.335s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:56:55 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] 8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4 was raw, converting to qcow2 {{(pid=86523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:56:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:55 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 Sep 29 18:56:55 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:56 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7" returned: 0 in 0.469s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4_400m189_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:56:56 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:56 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 1G Sep 29 18:56:56 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:56 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 1G" returned: 0 in 0.314s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Downloaded image 8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4 ((None, [{'url': 'file:///opt/stack/data/glance/images/8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4', 'metadata': {}}])) to volume 57b0c288-cb47-4c68-9026-88020f2beab7 successfully. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Temporary image 8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4 for user 841e7086096448caa0f1d9bb0d18e1ac is deleted. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Marking volume 57b0c288-cb47-4c68-9026-88020f2beab7 as bootable. {{(pid=86523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Copying metadata from image 8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4 to 57b0c288-cb47-4c68-9026-88020f2beab7. {{(pid=86523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Creating volume glance metadata for volume 57b0c288-cb47-4c68-9026-88020f2beab7 backed by image 8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b723c1c29d8e4a88aec1e1c1e9be3e8e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (328706bb-51a7-4e2b-9c52-eb5d51e1c377) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b0c288-cb47-4c68-9026-88020f2beab7', 'volume_size': 1, 'image_id': '8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b723c1c29d8e4a88aec1e1c1e9be3e8e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4ef92c4242264a299961f380e085d775', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9ace99a05d3af8d802acddafe5b4a65140418dd732ba6c9dba7ad14a0f415c54a47a6a3de6e55b9b5b565e5d5523b66989a0d1dadbab4e4342aeea64ad007be0', 'id': '8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4', 'created_at': datetime.datetime(2026, 9, 29, 16, 56, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 56, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8c4bb8c2-a383-4fd6-94a0-659d8ce77aa4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88576382-bca0-46b6-94c1-361d5f679e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:56:56 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Volume volume-57b0c288-cb47-4c68-9026-88020f2beab7 (57b0c288-cb47-4c68-9026-88020f2beab7): created successfully Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88576382-bca0-46b6-94c1-361d5f679e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Flow 'volume_create_manager' (d856b788-2f10-4a83-a8b1-f07c023433a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:56:56 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8f071448-b759-4988-8637-bc951d2bdca0 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Created volume successfully. Sep 29 18:56:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Acquiring lock "cinder-57b0c288-cb47-4c68-9026-88020f2beab7-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Lock "cinder-57b0c288-cb47-4c68-9026-88020f2beab7-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Acquiring lock "cinder-quobyte-57b0c288-cb47-4c68-9026-88020f2beab7" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Lock "cinder-quobyte-57b0c288-cb47-4c68-9026-88020f2beab7" acquired by "delete_volume" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ceda9ce-75bf-4954-8f20-664cd6e67c96]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:57 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 Sep 29 18:56:57 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:57 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7" returned: 0 in 0.361s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:57 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7 Sep 29 18:56:57 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:57 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57b0c288-cb47-4c68-9026-88020f2beab7" returned: 0 in 0.249s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Lock "cinder-quobyte-57b0c288-cb47-4c68-9026-88020f2beab7" released by "delete_volume" :: held 0.652s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:56:57 devstack cinder-volume[86523]: WARNING cinder.quota [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:56:57 devstack cinder-volume[86523]: WARNING cinder.quota [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Created reservations ['b949ee1d-3120-4259-80c3-aea519db301d', '35923f1f-5e88-4b73-9b18-14c1a87a01bc', '54d56fad-3549-41af-bbcc-c1d4b4886673', '1c115569-cbeb-48ea-90c6-8bc177be5364'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:56:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:57 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:56:57 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:58 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.239s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:56:58 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Deleted volume successfully. Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5e012e50-d326-4404-97e1-229d26f51403 tempest-VolumeAndVolumeTypeFromImageTest-2080896907 None] Lock "cinder-57b0c288-cb47-4c68-9026-88020f2beab7-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:56:58 devstack sudo[107178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:56:58 devstack sudo[107178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:56:58 devstack sudo[107178]: pam_unix(sudo:session): session closed for user root Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.265s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:56:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Flow 'volume_create_manager' (b95dc417-c643-4315-a0ea-4a1586634950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503c6b3f-f491-45ff-b9e7-af86df6af6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (503c6b3f-f491-45ff-b9e7-af86df6af6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1892834938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b9c244-eee2-4621-8208-4bcb2f904bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050c022b3cbe438c9e9be10b45bc23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:02Z,use_quota=True,user_id='b91c209e8ed743249ce9a9bef74b12c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844e7a9e-9e5b-4476-a7cf-0fb97fb9548c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844e7a9e-9e5b-4476-a7cf-0fb97fb9548c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ef79a5-2694-4337-87cb-06f7fce4ff08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62ef79a5-2694-4337-87cb-06f7fce4ff08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b9c244-eee2-4621-8208-4bcb2f904bab', 'volume_name': 'volume-55b9c244-eee2-4621-8208-4bcb2f904bab', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39d6fb3-309d-4295-97e1-4b052c264a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f39d6fb3-309d-4295-97e1-4b052c264a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f294f35-ee8b-4773-927f-a9cd6e03a79e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:02 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume 55b9c244-eee2-4621-8208-4bcb2f904bab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b9c244-eee2-4621-8208-4bcb2f904bab', 'volume_size': 1} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1892834938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b9c244-eee2-4621-8208-4bcb2f904bab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050c022b3cbe438c9e9be10b45bc23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:02Z,use_quota=True,user_id='b91c209e8ed743249ce9a9bef74b12c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Creating volume 55b9c244-eee2-4621-8208-4bcb2f904bab {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:02 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-55b9c244-eee2-4621-8208-4bcb2f904bab 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:02 devstack sudo[107225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-55b9c244-eee2-4621-8208-4bcb2f904bab 1073741824 Sep 29 18:57:02 devstack sudo[107225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:02 devstack sudo[107225]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-55b9c244-eee2-4621-8208-4bcb2f904bab 1073741824" returned: 0 in 0.399s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-55b9c244-eee2-4621-8208-4bcb2f904bab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:02 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-55b9c244-eee2-4621-8208-4bcb2f904bab Sep 29 18:57:02 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:03 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-55b9c244-eee2-4621-8208-4bcb2f904bab" returned: 0 in 0.237s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f294f35-ee8b-4773-927f-a9cd6e03a79e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b9c244-eee2-4621-8208-4bcb2f904bab', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0157ed-7f36-438b-9637-6ac6d7867a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:03 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume volume-55b9c244-eee2-4621-8208-4bcb2f904bab (55b9c244-eee2-4621-8208-4bcb2f904bab): created successfully Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f0157ed-7f36-438b-9637-6ac6d7867a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Flow 'volume_create_manager' (b95dc417-c643-4315-a0ea-4a1586634950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:03 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1b3629d9-f22b-40c6-9c38-59dec9d03b9c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Created volume successfully. Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Flow 'volume_create_manager' (978b36ec-1f03-405a-9f9c-672d1edd148c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6332abf8-1628-4f0b-a25e-cd0fb95c0f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6332abf8-1628-4f0b-a25e-cd0fb95c0f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1834905745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9975d5a8-ec69-453b-a854-fa51b91b76ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050c022b3cbe438c9e9be10b45bc23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:04Z,use_quota=True,user_id='b91c209e8ed743249ce9a9bef74b12c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b395bba-e51a-40fb-9f8d-341277919e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b395bba-e51a-40fb-9f8d-341277919e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f279a3-894d-47a4-badc-3de75b01a979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2f279a3-894d-47a4-badc-3de75b01a979) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9975d5a8-ec69-453b-a854-fa51b91b76ac', 'volume_name': 'volume-9975d5a8-ec69-453b-a854-fa51b91b76ac', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4230e3-f338-4b1a-9656-9c8762aca537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4230e3-f338-4b1a-9656-9c8762aca537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aefe5c4e-b17e-4366-8ae9-441396eebac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:03 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume 9975d5a8-ec69-453b-a854-fa51b91b76ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9975d5a8-ec69-453b-a854-fa51b91b76ac', 'volume_size': 1} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1834905745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9975d5a8-ec69-453b-a854-fa51b91b76ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050c022b3cbe438c9e9be10b45bc23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:04Z,use_quota=True,user_id='b91c209e8ed743249ce9a9bef74b12c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Creating volume 9975d5a8-ec69-453b-a854-fa51b91b76ac {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:03 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9975d5a8-ec69-453b-a854-fa51b91b76ac 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:03 devstack sudo[107235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9975d5a8-ec69-453b-a854-fa51b91b76ac 1073741824 Sep 29 18:57:03 devstack sudo[107235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Flow 'volume_create_manager' (52a37f46-e85a-420e-8484-2a1c6b00b66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881f25d9-2396-416b-bd99-0c6baa3a8d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (881f25d9-2396-416b-bd99-0c6baa3a8d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-331700387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5902556-f3dd-47ac-b14d-077b44a4cedd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050c022b3cbe438c9e9be10b45bc23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:04Z,use_quota=True,user_id='b91c209e8ed743249ce9a9bef74b12c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f05839-cc4c-4b0c-9e50-d767266edcad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f05839-cc4c-4b0c-9e50-d767266edcad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e4e0be-9635-497e-b244-40f405cf661d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93e4e0be-9635-497e-b244-40f405cf661d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5902556-f3dd-47ac-b14d-077b44a4cedd', 'volume_name': 'volume-b5902556-f3dd-47ac-b14d-077b44a4cedd', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e14b674-9e66-4e61-aeba-e058bd38b142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e14b674-9e66-4e61-aeba-e058bd38b142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6b8e92-477d-45f0-8ceb-5696cf0d4405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume b5902556-f3dd-47ac-b14d-077b44a4cedd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5902556-f3dd-47ac-b14d-077b44a4cedd', 'volume_size': 1} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:04 devstack sudo[107235]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9975d5a8-ec69-453b-a854-fa51b91b76ac 1073741824" returned: 0 in 0.540s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9975d5a8-ec69-453b-a854-fa51b91b76ac {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:04 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9975d5a8-ec69-453b-a854-fa51b91b76ac Sep 29 18:57:04 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Flow 'volume_create_manager' (1398def7-c760-44e1-a72c-665f09b671ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c88c8c-d9a6-41b7-b785-1563b108497d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81c88c8c-d9a6-41b7-b785-1563b108497d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-520665029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e9d12d-c586-4013-a41d-0eb814bf7aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050c022b3cbe438c9e9be10b45bc23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:04Z,use_quota=True,user_id='b91c209e8ed743249ce9a9bef74b12c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5e3634-7200-4023-92ed-ee7bca4f6141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc5e3634-7200-4023-92ed-ee7bca4f6141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef032f1-3890-4ff2-ad09-1e244f38ced9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef032f1-3890-4ff2-ad09-1e244f38ced9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e9d12d-c586-4013-a41d-0eb814bf7aa1', 'volume_name': 'volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14742cbf-e113-4a46-a3ea-d9ef660ed4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14742cbf-e113-4a46-a3ea-d9ef660ed4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15be31df-94b5-4e86-b8a1-2f296e690185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume 38e9d12d-c586-4013-a41d-0eb814bf7aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1', 'volume_size': 1} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:04 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9975d5a8-ec69-453b-a854-fa51b91b76ac" returned: 0 in 0.267s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.857s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.414s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-331700387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5902556-f3dd-47ac-b14d-077b44a4cedd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050c022b3cbe438c9e9be10b45bc23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:04Z,use_quota=True,user_id='b91c209e8ed743249ce9a9bef74b12c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Creating volume b5902556-f3dd-47ac-b14d-077b44a4cedd {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:04 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b5902556-f3dd-47ac-b14d-077b44a4cedd 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aefe5c4e-b17e-4366-8ae9-441396eebac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9975d5a8-ec69-453b-a854-fa51b91b76ac', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b5902556-f3dd-47ac-b14d-077b44a4cedd 1073741824 Sep 29 18:57:04 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc6259b-0e60-4451-babd-2a2efd1d34ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume volume-9975d5a8-ec69-453b-a854-fa51b91b76ac (9975d5a8-ec69-453b-a854-fa51b91b76ac): created successfully Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc6259b-0e60-4451-babd-2a2efd1d34ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Flow 'volume_create_manager' (978b36ec-1f03-405a-9f9c-672d1edd148c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:04 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-357a12cc-0b72-4360-b094-779610f24ce1 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Created volume successfully. Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Flow 'volume_create_manager' (8a1f85e4-fcf1-4fe0-aeaf-1038df41f0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d641dd5-fcfb-4110-a79e-15adc09d3682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d641dd5-fcfb-4110-a79e-15adc09d3682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1475458467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8701ef-b135-4442-b409-06065a986dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050c022b3cbe438c9e9be10b45bc23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:05Z,use_quota=True,user_id='b91c209e8ed743249ce9a9bef74b12c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0800379b-faac-4bf9-8edb-9e69f8d4ce3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0800379b-faac-4bf9-8edb-9e69f8d4ce3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b15ce2-4d33-4e68-9b40-eeb508c79ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94b15ce2-4d33-4e68-9b40-eeb508c79ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f8701ef-b135-4442-b409-06065a986dab', 'volume_name': 'volume-5f8701ef-b135-4442-b409-06065a986dab', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee2edd1-db9a-4e55-a61b-896648fda462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ee2edd1-db9a-4e55-a61b-896648fda462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54df7b1b-4e77-4dc1-b9e2-0048c244f383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:04 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume 5f8701ef-b135-4442-b409-06065a986dab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f8701ef-b135-4442-b409-06065a986dab', 'volume_size': 1} Sep 29 18:57:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:05 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b5902556-f3dd-47ac-b14d-077b44a4cedd 1073741824" returned: 0 in 0.519s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b5902556-f3dd-47ac-b14d-077b44a4cedd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:05 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b5902556-f3dd-47ac-b14d-077b44a4cedd Sep 29 18:57:05 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Flow 'volume_create_manager' (1f0e22e7-e2c4-4032-8c52-1fa731d93aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabb42c8-6def-4b01-af69-bf021eedea6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cabb42c8-6def-4b01-af69-bf021eedea6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1984765379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0aa6678-906e-4435-9f65-408895adacc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050c022b3cbe438c9e9be10b45bc23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:05Z,use_quota=True,user_id='b91c209e8ed743249ce9a9bef74b12c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db77d423-e9ed-4821-a6bb-19d0af10c3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db77d423-e9ed-4821-a6bb-19d0af10c3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e068c428-d03d-4b36-9f4f-738fb8a0590e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e068c428-d03d-4b36-9f4f-738fb8a0590e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0aa6678-906e-4435-9f65-408895adacc4', 'volume_name': 'volume-e0aa6678-906e-4435-9f65-408895adacc4', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7736af-d67e-4b43-935e-f8511578289e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7736af-d67e-4b43-935e-f8511578289e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b73fdf8-cdb3-475d-99ad-f067c29ac153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:05 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume e0aa6678-906e-4435-9f65-408895adacc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0aa6678-906e-4435-9f65-408895adacc4', 'volume_size': 1} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:05 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b5902556-f3dd-47ac-b14d-077b44a4cedd" returned: 0 in 0.235s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.808s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-520665029',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e9d12d-c586-4013-a41d-0eb814bf7aa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050c022b3cbe438c9e9be10b45bc23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:04Z,use_quota=True,user_id='b91c209e8ed743249ce9a9bef74b12c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Creating volume 38e9d12d-c586-4013-a41d-0eb814bf7aa1 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:05 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c6b8e92-477d-45f0-8ceb-5696cf0d4405) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5902556-f3dd-47ac-b14d-077b44a4cedd', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:05 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1 1073741824 Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347541b0-84aa-405c-a0bc-20e1818eff0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:05 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:05 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume volume-b5902556-f3dd-47ac-b14d-077b44a4cedd (b5902556-f3dd-47ac-b14d-077b44a4cedd): created successfully Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (347541b0-84aa-405c-a0bc-20e1818eff0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Flow 'volume_create_manager' (52a37f46-e85a-420e-8484-2a1c6b00b66b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:05 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-14b891fa-653e-42fa-a006-1bcd9b1a472c tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Created volume successfully. Sep 29 18:57:05 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1 1073741824" returned: 0 in 0.407s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:05 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1 Sep 29 18:57:05 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:06 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1" returned: 0 in 0.248s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] <== create_volume: return (692ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.173s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1475458467',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f8701ef-b135-4442-b409-06065a986dab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050c022b3cbe438c9e9be10b45bc23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:05Z,use_quota=True,user_id='b91c209e8ed743249ce9a9bef74b12c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Creating volume 5f8701ef-b135-4442-b409-06065a986dab {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:06 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5f8701ef-b135-4442-b409-06065a986dab 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15be31df-94b5-4e86-b8a1-2f296e690185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:06 devstack sudo[107261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5f8701ef-b135-4442-b409-06065a986dab 1073741824 Sep 29 18:57:06 devstack sudo[107261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4bf4e1-2beb-4b04-bce1-56e4eb48a668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:06 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1 (38e9d12d-c586-4013-a41d-0eb814bf7aa1): created successfully Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4bf4e1-2beb-4b04-bce1-56e4eb48a668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Flow 'volume_create_manager' (1398def7-c760-44e1-a72c-665f09b671ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:06 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1cb86dda-3f6f-4779-9226-5fc04a9bb7b8 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Created volume successfully. Sep 29 18:57:06 devstack sudo[107261]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5f8701ef-b135-4442-b409-06065a986dab 1073741824" returned: 0 in 0.434s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5f8701ef-b135-4442-b409-06065a986dab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:06 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5f8701ef-b135-4442-b409-06065a986dab Sep 29 18:57:06 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:06 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5f8701ef-b135-4442-b409-06065a986dab" returned: 0 in 0.236s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1984765379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0aa6678-906e-4435-9f65-408895adacc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='050c022b3cbe438c9e9be10b45bc23aa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:05Z,use_quota=True,user_id='b91c209e8ed743249ce9a9bef74b12c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Creating volume e0aa6678-906e-4435-9f65-408895adacc4 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:06 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e0aa6678-906e-4435-9f65-408895adacc4 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54df7b1b-4e77-4dc1-b9e2-0048c244f383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f8701ef-b135-4442-b409-06065a986dab', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:06 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e0aa6678-906e-4435-9f65-408895adacc4 1073741824 Sep 29 18:57:06 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e180f0-e236-4000-8375-1856c3ed997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:06 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume volume-5f8701ef-b135-4442-b409-06065a986dab (5f8701ef-b135-4442-b409-06065a986dab): created successfully Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2e180f0-e236-4000-8375-1856c3ed997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Flow 'volume_create_manager' (8a1f85e4-fcf1-4fe0-aeaf-1038df41f0f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:06 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-0b7674c1-4a56-4a76-b14e-447aa0ee710f tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Created volume successfully. Sep 29 18:57:07 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e0aa6678-906e-4435-9f65-408895adacc4 1073741824" returned: 0 in 0.404s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e0aa6678-906e-4435-9f65-408895adacc4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:07 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e0aa6678-906e-4435-9f65-408895adacc4 Sep 29 18:57:07 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:07 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e0aa6678-906e-4435-9f65-408895adacc4" returned: 0 in 0.249s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.690s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b73fdf8-cdb3-475d-99ad-f067c29ac153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0aa6678-906e-4435-9f65-408895adacc4', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc2700b-4e6c-4512-a13d-fcd946aa5a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:07 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Volume volume-e0aa6678-906e-4435-9f65-408895adacc4 (e0aa6678-906e-4435-9f65-408895adacc4): created successfully Sep 29 18:57:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc2700b-4e6c-4512-a13d-fcd946aa5a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:07 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Flow 'volume_create_manager' (1f0e22e7-e2c4-4032-8c52-1fa731d93aeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:07 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-15afb379-8ec5-47a1-9653-397ad6e6c7bc tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Created volume successfully. Sep 29 18:57:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "cinder-e0aa6678-906e-4435-9f65-408895adacc4-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-e0aa6678-906e-4435-9f65-408895adacc4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "cinder-quobyte-e0aa6678-906e-4435-9f65-408895adacc4" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:08 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-quobyte-e0aa6678-906e-4435-9f65-408895adacc4" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:08 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ba40911-b2b6-4380-96ea-bf5d55c9443e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e0aa6678-906e-4435-9f65-408895adacc4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:08 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e0aa6678-906e-4435-9f65-408895adacc4 Sep 29 18:57:08 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:09 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e0aa6678-906e-4435-9f65-408895adacc4" returned: 0 in 0.366s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e0aa6678-906e-4435-9f65-408895adacc4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:09 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e0aa6678-906e-4435-9f65-408895adacc4 Sep 29 18:57:09 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:09 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-e0aa6678-906e-4435-9f65-408895adacc4" returned: 0 in 0.249s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-quobyte-e0aa6678-906e-4435-9f65-408895adacc4" released by "delete_volume" :: held 0.657s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Created reservations ['eed3dea0-6a81-4c90-9dc3-408ce20d3743', '12f25abb-e76b-4af4-bda1-5ff6edc2ea70', 'b7644fb4-5b35-4635-85e8-817c4f6ff1e6', '5488e3b6-dcaa-438f-a7d8-98fa8dc4f4d1'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:09 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:09 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:09 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.243s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:09 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Deleted volume successfully. Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dead17d6-fbc7-4113-90fa-cfece5fc5379 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-e0aa6678-906e-4435-9f65-408895adacc4-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "cinder-5f8701ef-b135-4442-b409-06065a986dab-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-5f8701ef-b135-4442-b409-06065a986dab-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "cinder-quobyte-5f8701ef-b135-4442-b409-06065a986dab" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-quobyte-5f8701ef-b135-4442-b409-06065a986dab" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37ff756-d230-4f05-831e-57d4114047a1]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5f8701ef-b135-4442-b409-06065a986dab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:09 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5f8701ef-b135-4442-b409-06065a986dab Sep 29 18:57:09 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:10 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5f8701ef-b135-4442-b409-06065a986dab" returned: 0 in 0.361s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5f8701ef-b135-4442-b409-06065a986dab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:10 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5f8701ef-b135-4442-b409-06065a986dab Sep 29 18:57:10 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:10 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5f8701ef-b135-4442-b409-06065a986dab" returned: 0 in 0.250s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-quobyte-5f8701ef-b135-4442-b409-06065a986dab" released by "delete_volume" :: held 0.652s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Created reservations ['2c716683-c992-4cb3-8ca6-f7a43b068e3d', '89fd0360-6522-4bc8-9333-a27a42eb2ef0', '5f4f6a38-1e94-4ea1-a94a-1320684d092e', '8c8ceaf6-24e1-4617-883e-3d855232af86'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:10 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:10 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:10 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.252s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:10 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Deleted volume successfully. Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-500b8031-e919-47c8-ad07-534b299e497d tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-5f8701ef-b135-4442-b409-06065a986dab-delete_volume" released by "delete_volume" :: held 1.105s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "cinder-38e9d12d-c586-4013-a41d-0eb814bf7aa1-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:10 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-38e9d12d-c586-4013-a41d-0eb814bf7aa1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "cinder-quobyte-38e9d12d-c586-4013-a41d-0eb814bf7aa1" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-quobyte-38e9d12d-c586-4013-a41d-0eb814bf7aa1" acquired by "delete_volume" :: waited 0.014s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d3b324-4e66-4120-b306-8817d6ed5419]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:11 devstack sudo[107301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1 Sep 29 18:57:11 devstack sudo[107301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:11 devstack sudo[107301]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1" returned: 0 in 0.362s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:11 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1 Sep 29 18:57:11 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:11 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38e9d12d-c586-4013-a41d-0eb814bf7aa1" returned: 0 in 0.248s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-quobyte-38e9d12d-c586-4013-a41d-0eb814bf7aa1" released by "delete_volume" :: held 0.649s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Created reservations ['4bd9e322-58e7-4f15-88f9-61beada0b425', 'cc0a451b-3a39-4284-be73-a93d8a62d5d2', 'e33263af-6ee2-4082-a894-8478109bcb95', '7ba2b01e-110a-4553-87da-ae0f26bc829d'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:11 devstack sudo[107309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:11 devstack sudo[107309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:12 devstack sudo[107309]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.245s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:12 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Deleted volume successfully. Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-19ead355-672a-43a6-bc8c-5f16818f3de6 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-38e9d12d-c586-4013-a41d-0eb814bf7aa1-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "cinder-b5902556-f3dd-47ac-b14d-077b44a4cedd-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-b5902556-f3dd-47ac-b14d-077b44a4cedd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "cinder-quobyte-b5902556-f3dd-47ac-b14d-077b44a4cedd" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-quobyte-b5902556-f3dd-47ac-b14d-077b44a4cedd" acquired by "delete_volume" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9667e0-8370-44f2-9e5f-eed7bd223648]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b5902556-f3dd-47ac-b14d-077b44a4cedd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:12 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b5902556-f3dd-47ac-b14d-077b44a4cedd Sep 29 18:57:12 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:12 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b5902556-f3dd-47ac-b14d-077b44a4cedd" returned: 0 in 0.353s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b5902556-f3dd-47ac-b14d-077b44a4cedd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:12 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b5902556-f3dd-47ac-b14d-077b44a4cedd Sep 29 18:57:12 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:12 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b5902556-f3dd-47ac-b14d-077b44a4cedd" returned: 0 in 0.247s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-quobyte-b5902556-f3dd-47ac-b14d-077b44a4cedd" released by "delete_volume" :: held 0.641s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Created reservations ['68d9eca5-47e0-48e3-8a13-6b216f93361e', '79e1ae93-bea1-4bdc-ad15-6ae3558c21ce', '7e0d7e4a-f11b-4b6e-a23e-79cda09d8f9f', '8f5077a7-2751-4d7e-9fd8-61e246cb78c5'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:12 devstack sudo[107320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:12 devstack sudo[107320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:13 devstack sudo[107320]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.238s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:13 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:13 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Deleted volume successfully. Sep 29 18:57:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-72296aa5-0294-4c18-8805-ab17b5d1c734 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-b5902556-f3dd-47ac-b14d-077b44a4cedd-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "cinder-9975d5a8-ec69-453b-a854-fa51b91b76ac-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-9975d5a8-ec69-453b-a854-fa51b91b76ac-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "cinder-quobyte-9975d5a8-ec69-453b-a854-fa51b91b76ac" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-quobyte-9975d5a8-ec69-453b-a854-fa51b91b76ac" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:13 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f246964-304a-4e8d-aeb9-ce4953f431ac]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9975d5a8-ec69-453b-a854-fa51b91b76ac {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:13 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9975d5a8-ec69-453b-a854-fa51b91b76ac Sep 29 18:57:13 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:13 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9975d5a8-ec69-453b-a854-fa51b91b76ac" returned: 0 in 0.369s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9975d5a8-ec69-453b-a854-fa51b91b76ac {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:13 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9975d5a8-ec69-453b-a854-fa51b91b76ac Sep 29 18:57:13 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:14 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-9975d5a8-ec69-453b-a854-fa51b91b76ac" returned: 0 in 0.260s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-quobyte-9975d5a8-ec69-453b-a854-fa51b91b76ac" released by "delete_volume" :: held 0.670s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Created reservations ['8818be64-feb6-4e3f-bfca-27f8167d46f1', 'a9924fdf-fa8f-46fe-b754-1ddf6f3cf7b4', '2f82c6fd-4e36-4349-a1e6-9cb081d1ec16', '225031c5-7757-4c91-883d-57756ef8a9c3'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:14 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:14 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:14 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.239s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:14 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Deleted volume successfully. Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a5e31891-c42d-4956-a37c-8a937c0daab9 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-9975d5a8-ec69-453b-a854-fa51b91b76ac-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "cinder-55b9c244-eee2-4621-8208-4bcb2f904bab-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-55b9c244-eee2-4621-8208-4bcb2f904bab-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "cinder-quobyte-55b9c244-eee2-4621-8208-4bcb2f904bab" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-quobyte-55b9c244-eee2-4621-8208-4bcb2f904bab" acquired by "delete_volume" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63c4378-0850-4084-b227-fc9f02d15102]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-55b9c244-eee2-4621-8208-4bcb2f904bab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:14 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-55b9c244-eee2-4621-8208-4bcb2f904bab Sep 29 18:57:14 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:14 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-55b9c244-eee2-4621-8208-4bcb2f904bab" returned: 0 in 0.350s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-55b9c244-eee2-4621-8208-4bcb2f904bab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:14 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-55b9c244-eee2-4621-8208-4bcb2f904bab Sep 29 18:57:14 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:15 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-55b9c244-eee2-4621-8208-4bcb2f904bab" returned: 0 in 0.237s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-quobyte-55b9c244-eee2-4621-8208-4bcb2f904bab" released by "delete_volume" :: held 0.629s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:15 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Created reservations ['c4eb0679-6c1a-43b7-beb5-114e7bb43fd4', '3492898c-d232-450d-b8b5-edab560cd001', '19bccca9-94bb-40ca-a0c0-67d3ea3e4dbc', 'e26e1530-4c7b-4c7b-8713-b74b95c59771'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:15 devstack sudo[107344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:15 devstack sudo[107344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:15 devstack sudo[107344]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.244s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:15 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Deleted volume successfully. Sep 29 18:57:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a3f7ed51-0ced-4c16-874d-08506c786d77 tempest-CreateVolumesFromSourceVolumeTest-1289975787 None] Lock "cinder-55b9c244-eee2-4621-8208-4bcb2f904bab-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Flow 'volume_create_manager' (873dbd43-bd6a-4f4f-a60f-4fe329e299f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb173f3a-3de6-4f68-861c-d0f2e5754dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb173f3a-3de6-4f68-861c-d0f2e5754dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d754af-96f7-496c-afb2-065f6ce60db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c481260b9cc42758f48b0d3b8ffad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:18Z,use_quota=True,user_id='e6870ea2de594af0bebf370bf6a0a7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3872803-cd7a-481b-9340-9941b5dcba6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3872803-cd7a-481b-9340-9941b5dcba6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f9cb50-f939-4981-b099-a6149954b368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f9cb50-f939-4981-b099-a6149954b368) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93d754af-96f7-496c-afb2-065f6ce60db9', 'volume_name': 'volume-93d754af-96f7-496c-afb2-065f6ce60db9', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f1d550-75fa-422b-899d-ce7b4d763232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03f1d550-75fa-422b-899d-ce7b4d763232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b0f55a-7dc2-409e-a7c3-2c3ee2ea1acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:18 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Volume 93d754af-96f7-496c-afb2-065f6ce60db9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93d754af-96f7-496c-afb2-065f6ce60db9', 'volume_size': 1} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93d754af-96f7-496c-afb2-065f6ce60db9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c481260b9cc42758f48b0d3b8ffad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:18Z,use_quota=True,user_id='e6870ea2de594af0bebf370bf6a0a7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Creating volume 93d754af-96f7-496c-afb2-065f6ce60db9 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:18 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-93d754af-96f7-496c-afb2-065f6ce60db9 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:18 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-93d754af-96f7-496c-afb2-065f6ce60db9 1073741824 Sep 29 18:57:18 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:18 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-93d754af-96f7-496c-afb2-065f6ce60db9 1073741824" returned: 0 in 0.408s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-93d754af-96f7-496c-afb2-065f6ce60db9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:18 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-93d754af-96f7-496c-afb2-065f6ce60db9 Sep 29 18:57:18 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:19 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-93d754af-96f7-496c-afb2-065f6ce60db9" returned: 0 in 0.237s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22b0f55a-7dc2-409e-a7c3-2c3ee2ea1acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93d754af-96f7-496c-afb2-065f6ce60db9', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782de2ad-c3fa-429b-bfd1-91f2c9eec7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:19 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Volume volume-93d754af-96f7-496c-afb2-065f6ce60db9 (93d754af-96f7-496c-afb2-065f6ce60db9): created successfully Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (782de2ad-c3fa-429b-bfd1-91f2c9eec7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Flow 'volume_create_manager' (873dbd43-bd6a-4f4f-a60f-4fe329e299f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:19 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d5b7e011-06d4-4c35-84c0-53d4fd4a793d tempest-CinderUnicodeTest-82784313 None] Created volume successfully. Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Flow 'volume_create_manager' (77eaaaed-7465-48cb-a290-784f75db1988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eccb555-d09d-4e6e-877e-58827a6c359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eccb555-d09d-4e6e-877e-58827a6c359c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1448770852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59029723-5a33-4fff-8975-5acd71ad22f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c481260b9cc42758f48b0d3b8ffad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:20Z,use_quota=True,user_id='e6870ea2de594af0bebf370bf6a0a7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e616c8-c054-47ee-8d18-0f1edac56267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e616c8-c054-47ee-8d18-0f1edac56267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a3293f-b619-4a73-9c07-4aa9450fa0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4a3293f-b619-4a73-9c07-4aa9450fa0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59029723-5a33-4fff-8975-5acd71ad22f8', 'volume_name': 'volume-59029723-5a33-4fff-8975-5acd71ad22f8', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71eccc92-27be-4927-adbb-834f863d830c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71eccc92-27be-4927-adbb-834f863d830c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea440d6-0bc4-4213-8567-3cff3218d4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:19 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Volume 59029723-5a33-4fff-8975-5acd71ad22f8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59029723-5a33-4fff-8975-5acd71ad22f8', 'volume_size': 1} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1448770852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59029723-5a33-4fff-8975-5acd71ad22f8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c481260b9cc42758f48b0d3b8ffad53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:20Z,use_quota=True,user_id='e6870ea2de594af0bebf370bf6a0a7a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Creating volume 59029723-5a33-4fff-8975-5acd71ad22f8 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:19 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:19 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8 1073741824 Sep 29 18:57:19 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:20 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8 1073741824" returned: 0 in 0.422s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:20 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8 Sep 29 18:57:20 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:20 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8" returned: 0 in 0.255s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cea440d6-0bc4-4213-8567-3cff3218d4cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59029723-5a33-4fff-8975-5acd71ad22f8', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6397a877-ff5c-40a2-9b1e-e3d7ecb00cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:20 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Volume volume-59029723-5a33-4fff-8975-5acd71ad22f8 (59029723-5a33-4fff-8975-5acd71ad22f8): created successfully Sep 29 18:57:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6397a877-ff5c-40a2-9b1e-e3d7ecb00cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Flow 'volume_create_manager' (77eaaaed-7465-48cb-a290-784f75db1988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3b65d25f-a523-4838-aa54-a11eb677faaa tempest-CinderUnicodeTest-82784313 None] Created volume successfully. Sep 29 18:57:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] Creating offline snapshot cdf3d527-c522-4dca-9001-9fbb026bfbde of volume 59029723-5a33-4fff-8975-5acd71ad22f8 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:57:21 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ba0055-58c0-46be-819f-bb89997a3e9a]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:21 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8 Sep 29 18:57:21 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:21 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8" returned: 0 in 0.386s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:21 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde 1G Sep 29 18:57:21 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:21 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde 1G" returned: 0 in 0.398s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59029723-5a33-4fff-8975-5acd71ad22f8 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:21 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59029723-5a33-4fff-8975-5acd71ad22f8 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde Sep 29 18:57:21 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:22 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59029723-5a33-4fff-8975-5acd71ad22f8 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde" returned: 0 in 0.285s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:22 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde is being set with open permissions: ugo+rw Sep 29 18:57:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:22 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde Sep 29 18:57:22 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:22 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde" returned: 0 in 0.237s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:22 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.info Sep 29 18:57:22 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:22 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.info" returned: 0 in 0.254s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:22 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.info is being set with open permissions: ugo+rw Sep 29 18:57:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:22 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.info Sep 29 18:57:22 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:22 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.info" returned: 0 in 0.240s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.890s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:23 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-17ec45b2-6cfd-4270-a0ee-4cb88b8ff632 tempest-CinderUnicodeTest-82784313 None] Create snapshot completed successfully Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Acquiring lock "cinder-cdf3d527-c522-4dca-9001-9fbb026bfbde-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Lock "cinder-cdf3d527-c522-4dca-9001-9fbb026bfbde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Acquiring lock "cinder-quobyte-59029723-5a33-4fff-8975-5acd71ad22f8" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Lock "cinder-quobyte-59029723-5a33-4fff-8975-5acd71ad22f8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Acquiring lock "cinder-quobyte-cdf3d527-c522-4dca-9001-9fbb026bfbde" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Lock "cinder-quobyte-cdf3d527-c522-4dca-9001-9fbb026bfbde" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Deleting offline snapshot cdf3d527-c522-4dca-9001-9fbb026bfbde of volume 59029723-5a33-4fff-8975-5acd71ad22f8 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] snapshot_file for this snap is: volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b12f586-5908-4dad-b8a6-8c72f85a028b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:23 devstack sudo[107388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde Sep 29 18:57:23 devstack sudo[107388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:23 devstack sudo[107388]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde" returned: 0 in 0.367s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59029723-5a33-4fff-8975-5acd71ad22f8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa9a3e30-d650-411c-955a-8bbda96b8d9e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:23 devstack sudo[107394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8 Sep 29 18:57:23 devstack sudo[107394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:24 devstack sudo[107394]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8" returned: 0 in 0.359s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:24 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde Sep 29 18:57:24 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:24 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde" returned: 0 in 0.333s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:24 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde Sep 29 18:57:24 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:24 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8.cdf3d527-c522-4dca-9001-9fbb026bfbde" returned: 0 in 0.240s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Lock "cinder-quobyte-cdf3d527-c522-4dca-9001-9fbb026bfbde" released by "_delete_snapshot" :: held 1.411s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Lock "cinder-quobyte-59029723-5a33-4fff-8975-5acd71ad22f8" released by "delete_snapshot" :: held 1.431s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:24 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Created reservations ['a95cae5a-b237-4552-a5c2-a10ff6928347', '33d03623-0d32-41b0-9850-f3a050983734', '7fb913f0-5b33-4e54-a71e-9210f3b71ca0', 'c97370d4-6f31-4249-b96b-e512e701984f'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:24 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Delete snapshot completed successfully. Sep 29 18:57:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a64ea13e-af61-4074-873c-5a8cb6fa617d tempest-CinderUnicodeTest-82784313 None] Lock "cinder-cdf3d527-c522-4dca-9001-9fbb026bfbde-delete_snapshot" released by "delete_snapshot" :: held 1.554s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Acquiring lock "cinder-59029723-5a33-4fff-8975-5acd71ad22f8-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Lock "cinder-59029723-5a33-4fff-8975-5acd71ad22f8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Acquiring lock "cinder-quobyte-59029723-5a33-4fff-8975-5acd71ad22f8" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Lock "cinder-quobyte-59029723-5a33-4fff-8975-5acd71ad22f8" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:25 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd10fc6-4cb0-47aa-a912-4f539f6f4c2f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:25 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8 Sep 29 18:57:25 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:25 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8" returned: 0 in 0.367s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:25 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8 Sep 29 18:57:25 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:26 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-59029723-5a33-4fff-8975-5acd71ad22f8" returned: 0 in 0.258s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Lock "cinder-quobyte-59029723-5a33-4fff-8975-5acd71ad22f8" released by "delete_volume" :: held 0.686s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Created reservations ['3c54ff92-25aa-4f15-a076-a742dfcad0de', 'add73d1b-1390-4cf5-962c-a95301a81e36', '7f783773-8b17-41c7-a706-d0f203abd15f', '87382c5b-af47-4814-b0fa-a55d361bf10d'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:26 devstack sudo[107415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:26 devstack sudo[107415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:26 devstack sudo[107415]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.283s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:26 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Deleted volume successfully. Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1a5e6af8-ebb8-47c4-978c-75fce6feb22d tempest-CinderUnicodeTest-82784313 None] Lock "cinder-59029723-5a33-4fff-8975-5acd71ad22f8-delete_volume" released by "delete_volume" :: held 1.183s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Acquiring lock "cinder-93d754af-96f7-496c-afb2-065f6ce60db9-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Lock "cinder-93d754af-96f7-496c-afb2-065f6ce60db9-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Acquiring lock "cinder-quobyte-93d754af-96f7-496c-afb2-065f6ce60db9" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Lock "cinder-quobyte-93d754af-96f7-496c-afb2-065f6ce60db9" acquired by "delete_volume" :: waited 0.014s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[326e8e8f-3b35-47b8-b338-84c87f14ba75]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-93d754af-96f7-496c-afb2-065f6ce60db9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:26 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-93d754af-96f7-496c-afb2-065f6ce60db9 Sep 29 18:57:26 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:27 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-93d754af-96f7-496c-afb2-065f6ce60db9" returned: 0 in 0.369s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-93d754af-96f7-496c-afb2-065f6ce60db9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:27 devstack sudo[107423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-93d754af-96f7-496c-afb2-065f6ce60db9 Sep 29 18:57:27 devstack sudo[107423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:27 devstack sudo[107423]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-93d754af-96f7-496c-afb2-065f6ce60db9" returned: 0 in 0.249s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Lock "cinder-quobyte-93d754af-96f7-496c-afb2-065f6ce60db9" released by "delete_volume" :: held 0.661s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Created reservations ['91cf636e-71cc-48b9-968a-73ae91bcb767', 'd61df401-1706-41f6-b848-18f0c2579d8a', 'f964d4e8-76a3-4d57-aa23-e8edc3d2af3e', '9d7743f9-629c-40cb-8411-1fa1e53aa668'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:27 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:27 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:27 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.246s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Deleted volume successfully. Sep 29 18:57:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-dccc8682-8e3f-4ce5-8647-36613e3516e4 tempest-CinderUnicodeTest-82784313 None] Lock "cinder-93d754af-96f7-496c-afb2-065f6ce60db9-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:37 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=82,cinder:UPDATE=113,cinder:INSERT=29,cinder:DELETE=10 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:57:37 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=74,cinder:UPDATE=102,cinder:INSERT=31,cinder:DELETE=9 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Flow 'volume_create_manager' (3119b8b1-015c-47f0-a1d0-644b11a20752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64daa437-2913-4a5a-ae99-98bb00031975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64daa437-2913-4a5a-ae99-98bb00031975) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-616111715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448fa67e-19d9-4ff3-a056-a38a2bc34f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a248686d994467d96e584301c1ac1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:40Z,use_quota=True,user_id='2947129af332444f8f4f495bf191d5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207b2e60-2ded-42dd-aed3-f35fd9d33047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (207b2e60-2ded-42dd-aed3-f35fd9d33047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5515ffa-d3a8-477a-8c3a-a07448ad8431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5515ffa-d3a8-477a-8c3a-a07448ad8431) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '448fa67e-19d9-4ff3-a056-a38a2bc34f2c', 'volume_name': 'volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c52889-2706-4bf8-97f6-914fa10e906c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c52889-2706-4bf8-97f6-914fa10e906c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224be3d4-0af6-4c41-baac-af86d42919a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:39 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Volume 448fa67e-19d9-4ff3-a056-a38a2bc34f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c', 'volume_size': 1} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-616111715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=448fa67e-19d9-4ff3-a056-a38a2bc34f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a248686d994467d96e584301c1ac1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:40Z,use_quota=True,user_id='2947129af332444f8f4f495bf191d5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Creating volume 448fa67e-19d9-4ff3-a056-a38a2bc34f2c {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:39 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:39 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c 1073741824 Sep 29 18:57:39 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Flow 'volume_create_manager' (770eff61-39b4-45bb-8b86-1f0ae53fdb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74b10d1-3000-4334-91c8-ce21b12d539c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a74b10d1-3000-4334-91c8-ce21b12d539c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436020227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c8da42-578b-4e57-bcb2-a69e4f99f170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a248686d994467d96e584301c1ac1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:40Z,use_quota=True,user_id='2947129af332444f8f4f495bf191d5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b97f98c-6686-4f52-902c-eacb05054c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b97f98c-6686-4f52-902c-eacb05054c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43956584-c02d-4ad3-9a10-89242069f3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43956584-c02d-4ad3-9a10-89242069f3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38c8da42-578b-4e57-bcb2-a69e4f99f170', 'volume_name': 'volume-38c8da42-578b-4e57-bcb2-a69e4f99f170', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c1f17d-3e4d-42d0-b1dd-f578f96601d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9c1f17d-3e4d-42d0-b1dd-f578f96601d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e4e99f-0bc3-4a40-83f3-dc4fc516d6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:40 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Volume 38c8da42-578b-4e57-bcb2-a69e4f99f170: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38c8da42-578b-4e57-bcb2-a69e4f99f170', 'volume_size': 1} Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:40 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c 1073741824" returned: 0 in 0.632s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:40 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c Sep 29 18:57:40 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-699c3487-340c-42cd-b4f1-e1d09f57a4f6 tempest-ProjectAdminTests-643823643 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1774.9084281921387, 'free_capacity_gb': 1774.9084281921387, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86523) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4870}} Sep 29 18:57:40 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c" returned: 0 in 0.391s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] <== create_volume: return (1097ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-436020227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38c8da42-578b-4e57-bcb2-a69e4f99f170,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a248686d994467d96e584301c1ac1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:40Z,use_quota=True,user_id='2947129af332444f8f4f495bf191d5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Creating volume 38c8da42-578b-4e57-bcb2-a69e4f99f170 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:41 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38c8da42-578b-4e57-bcb2-a69e4f99f170 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Flow 'volume_create_manager' (8811f353-9168-436a-ba16-9831c93c6710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315a4fa5-ac6f-4870-8d1a-5eef1917eb35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:41 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38c8da42-578b-4e57-bcb2-a69e4f99f170 1073741824 Sep 29 18:57:41 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (224be3d4-0af6-4c41-baac-af86d42919a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8dace2-98d4-41e0-bc98-a8758a9e09de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (315a4fa5-ac6f-4870-8d1a-5eef1917eb35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1380054222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3340e125-6b9f-4a38-ba9c-0f94292b5ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a248686d994467d96e584301c1ac1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:41Z,use_quota=True,user_id='2947129af332444f8f4f495bf191d5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62094e8-c325-4dc8-9ce6-0433279dfa38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f62094e8-c325-4dc8-9ce6-0433279dfa38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd74ca5-85c2-4b85-b297-3f427fb083c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcd74ca5-85c2-4b85-b297-3f427fb083c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3340e125-6b9f-4a38-ba9c-0f94292b5ec2', 'volume_name': 'volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd943dc0-a64c-492a-a13b-3c22cf930280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd943dc0-a64c-492a-a13b-3c22cf930280) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34751117-9316-4448-985e-bfc57215c354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:41 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Volume 3340e125-6b9f-4a38-ba9c-0f94292b5ec2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2', 'volume_size': 1} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:41 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Volume volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c (448fa67e-19d9-4ff3-a056-a38a2bc34f2c): created successfully Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef8dace2-98d4-41e0-bc98-a8758a9e09de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Flow 'volume_create_manager' (3119b8b1-015c-47f0-a1d0-644b11a20752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:41 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-96574ed6-3ad3-480a-9248-05054897f4cf tempest-CreateVolumesFromImageTest-866997194 None] Created volume successfully. Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Flow 'volume_create_manager' (09ac1a07-fc84-4fbf-8b23-e075e05a69c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339bb89a-79bb-4286-a66d-bc43c79cf181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (339bb89a-79bb-4286-a66d-bc43c79cf181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-619307559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd3a320-716a-4259-839b-e1c37d5c5e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a248686d994467d96e584301c1ac1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:41Z,use_quota=True,user_id='2947129af332444f8f4f495bf191d5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b8a316-c65a-433b-b638-09fd5d86acc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39b8a316-c65a-433b-b638-09fd5d86acc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0580142-4aec-4381-87fd-236b633f9c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0580142-4aec-4381-87fd-236b633f9c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd3a320-716a-4259-839b-e1c37d5c5e88', 'volume_name': 'volume-dcd3a320-716a-4259-839b-e1c37d5c5e88', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5602c4d-1ce7-4999-ae71-f6e8df62181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5602c4d-1ce7-4999-ae71-f6e8df62181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33990b9f-94ae-4810-ab0e-91deb17127f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:41 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Volume dcd3a320-716a-4259-839b-e1c37d5c5e88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd3a320-716a-4259-839b-e1c37d5c5e88', 'volume_size': 1} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:41 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38c8da42-578b-4e57-bcb2-a69e4f99f170 1073741824" returned: 0 in 0.828s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38c8da42-578b-4e57-bcb2-a69e4f99f170 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:41 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38c8da42-578b-4e57-bcb2-a69e4f99f170 Sep 29 18:57:41 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Flow 'volume_create_manager' (f987ee19-722e-4b38-baf4-0ef0118f6235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c449eb-c38c-4507-9588-8af5b52337a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c449eb-c38c-4507-9588-8af5b52337a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2054813018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8203737f-a6d0-40c1-923c-4ef5a40d5a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a248686d994467d96e584301c1ac1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:42Z,use_quota=True,user_id='2947129af332444f8f4f495bf191d5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c8950b-7809-46ee-9b58-ec521e7fcf9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0c8950b-7809-46ee-9b58-ec521e7fcf9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82c9549-50ec-457e-9569-aa0257b135d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82c9549-50ec-457e-9569-aa0257b135d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8203737f-a6d0-40c1-923c-4ef5a40d5a68', 'volume_name': 'volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47800dc-f49e-4502-9661-852815172b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:42 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d47800dc-f49e-4502-9661-852815172b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48335e8-f83b-480f-841c-58bea86efedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:42 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Volume 8203737f-a6d0-40c1-923c-4ef5a40d5a68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68', 'volume_size': 1} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38c8da42-578b-4e57-bcb2-a69e4f99f170" returned: 0 in 0.328s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] <== create_volume: return (1223ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.041s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1380054222',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3340e125-6b9f-4a38-ba9c-0f94292b5ec2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a248686d994467d96e584301c1ac1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:41Z,use_quota=True,user_id='2947129af332444f8f4f495bf191d5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Creating volume 3340e125-6b9f-4a38-ba9c-0f94292b5ec2 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:42 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e4e99f-0bc3-4a40-83f3-dc4fc516d6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38c8da42-578b-4e57-bcb2-a69e4f99f170', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a52a604-3229-476d-8458-3a1425758bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:42 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2 1073741824 Sep 29 18:57:42 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:42 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Volume volume-38c8da42-578b-4e57-bcb2-a69e4f99f170 (38c8da42-578b-4e57-bcb2-a69e4f99f170): created successfully Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a52a604-3229-476d-8458-3a1425758bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Flow 'volume_create_manager' (770eff61-39b4-45bb-8b86-1f0ae53fdb9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:42 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-fada4cf3-d923-473c-b6b8-3f438280b4b1 tempest-CreateVolumesFromImageTest-866997194 None] Created volume successfully. Sep 29 18:57:42 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2 1073741824" returned: 0 in 0.599s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:42 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2 Sep 29 18:57:42 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:43 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2" returned: 0 in 0.361s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.710s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-619307559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd3a320-716a-4259-839b-e1c37d5c5e88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a248686d994467d96e584301c1ac1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:41Z,use_quota=True,user_id='2947129af332444f8f4f495bf191d5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Creating volume dcd3a320-716a-4259-839b-e1c37d5c5e88 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:43 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dcd3a320-716a-4259-839b-e1c37d5c5e88 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34751117-9316-4448-985e-bfc57215c354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428aa96f-0a41-48cb-a3c7-cd796c8f94dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:43 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dcd3a320-716a-4259-839b-e1c37d5c5e88 1073741824 Sep 29 18:57:43 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:43 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Volume volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2 (3340e125-6b9f-4a38-ba9c-0f94292b5ec2): created successfully Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428aa96f-0a41-48cb-a3c7-cd796c8f94dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Flow 'volume_create_manager' (8811f353-9168-436a-ba16-9831c93c6710) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:43 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a198ad0f-b594-4178-af70-058f54caba69 tempest-CreateVolumesFromImageTest-866997194 None] Created volume successfully. Sep 29 18:57:43 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dcd3a320-716a-4259-839b-e1c37d5c5e88 1073741824" returned: 0 in 0.569s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dcd3a320-716a-4259-839b-e1c37d5c5e88 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:43 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dcd3a320-716a-4259-839b-e1c37d5c5e88 Sep 29 18:57:43 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:44 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dcd3a320-716a-4259-839b-e1c37d5c5e88" returned: 0 in 0.363s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.050s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2054813018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8203737f-a6d0-40c1-923c-4ef5a40d5a68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a248686d994467d96e584301c1ac1ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:42Z,use_quota=True,user_id='2947129af332444f8f4f495bf191d5ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Creating volume 8203737f-a6d0-40c1-923c-4ef5a40d5a68 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:44 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33990b9f-94ae-4810-ab0e-91deb17127f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd3a320-716a-4259-839b-e1c37d5c5e88', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:44 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68 1073741824 Sep 29 18:57:44 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0e6cac-9c14-45b7-b2c9-3c2be6f989a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:44 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Volume volume-dcd3a320-716a-4259-839b-e1c37d5c5e88 (dcd3a320-716a-4259-839b-e1c37d5c5e88): created successfully Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c0e6cac-9c14-45b7-b2c9-3c2be6f989a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Flow 'volume_create_manager' (09ac1a07-fc84-4fbf-8b23-e075e05a69c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Flow 'volume_create_manager' (88775f55-a4fe-4e01-b753-ad478793ebd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00fad51-ff90-4e78-be6e-1e9c836bd4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:44 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6b3f9919-ffdc-4706-b568-5c81c442d00c tempest-CreateVolumesFromImageTest-866997194 None] Created volume successfully. Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e00fad51-ff90-4e78-be6e-1e9c836bd4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c94c922-fb84-4aaa-a8d7-0712e80fd517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7ff29f3b4947f6b161b5dbe0f8f976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:44Z,use_quota=True,user_id='6d966c76275041ad8cb15cceea55f18b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15d2cf1-b6f6-4197-a678-b8425934c9b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15d2cf1-b6f6-4197-a678-b8425934c9b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f34d315-7b8a-43e7-97fa-1870b1423531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG cinder.image.glance [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Creating Keystone auth plugin from conf {{(pid=86523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:57:44 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68 1073741824" returned: 0 in 0.588s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:44 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68 Sep 29 18:57:44 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f34d315-7b8a-43e7-97fa-1870b1423531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4c94c922-fb84-4aaa-a8d7-0712e80fd517', 'volume_name': 'volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517', 'volume_size': 1, 'image_id': 'c2513818-aefe-48f9-9b3d-a8afabdc3264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2513818-aefe-48f9-9b3d-a8afabdc3264', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2bbe76a9f54587ba9333da01b81a0f4c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b7ff29f3b4947f6b161b5dbe0f8f976', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7424be42611a1dae0de7460bf159992b04cebb24d0e7d3fca4d0419884ac20d785719446fe4c643caf669e82159442f248043d9a52ce04b65e2a7b5d7f980f55', 'id': 'c2513818-aefe-48f9-9b3d-a8afabdc3264', 'created_at': datetime.datetime(2026, 9, 29, 16, 57, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 57, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2513818-aefe-48f9-9b3d-a8afabdc3264/file', 'properties': {}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21af8e76-a9d6-4b7b-bc64-423efcbed884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21af8e76-a9d6-4b7b-bc64-423efcbed884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95737784-1682-42ad-859e-65f1e8aaf742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:45 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Volume 4c94c922-fb84-4aaa-a8d7-0712e80fd517: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517', 'volume_size': 1, 'image_id': 'c2513818-aefe-48f9-9b3d-a8afabdc3264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2513818-aefe-48f9-9b3d-a8afabdc3264', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2bbe76a9f54587ba9333da01b81a0f4c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b7ff29f3b4947f6b161b5dbe0f8f976', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7424be42611a1dae0de7460bf159992b04cebb24d0e7d3fca4d0419884ac20d785719446fe4c643caf669e82159442f248043d9a52ce04b65e2a7b5d7f980f55', 'id': 'c2513818-aefe-48f9-9b3d-a8afabdc3264', 'created_at': datetime.datetime(2026, 9, 29, 16, 57, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 57, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2513818-aefe-48f9-9b3d-a8afabdc3264/file', 'properties': {}}, 'image_service': } Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Trying to clone 4c94c922-fb84-4aaa-a8d7-0712e80fd517 from image c2513818-aefe-48f9-9b3d-a8afabdc3264 at location (None, [{'url': 'file:///opt/stack/data/glance/images/c2513818-aefe-48f9-9b3d-a8afabdc3264', 'metadata': {}}]). {{(pid=86523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:57:45 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Image download 0.00 MB at 0.00 MB/s Sep 29 18:57:45 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68" returned: 0 in 0.320s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c42839-b8b2-4168-8dbf-9704e7d6779a]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48335e8-f83b-480f-841c-58bea86efedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1193af2a-e953-4a3c-9b24-eeac30a32367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:45 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Volume volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68 (8203737f-a6d0-40c1-923c-4ef5a40d5a68): created successfully Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1193af2a-e953-4a3c-9b24-eeac30a32367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Flow 'volume_create_manager' (f987ee19-722e-4b38-baf4-0ef0118f6235) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:45 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a726dd27-93fa-4943-8160-01fe8e3c5a17 tempest-CreateVolumesFromImageTest-866997194 None] Created volume successfully. Sep 29 18:57:45 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD Sep 29 18:57:45 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "cinder-8203737f-a6d0-40c1-923c-4ef5a40d5a68-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:45 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD" returned: 0 in 0.413s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-8203737f-a6d0-40c1-923c-4ef5a40d5a68-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "cinder-quobyte-8203737f-a6d0-40c1-923c-4ef5a40d5a68" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-quobyte-8203737f-a6d0-40c1-923c-4ef5a40d5a68" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:45 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD Sep 29 18:57:45 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b5d4fb-55cd-4dd9-8e39-373514141906]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:45 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68 Sep 29 18:57:45 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:46 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD" returned: 1 in 0.443s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Temporary image c2513818-aefe-48f9-9b3d-a8afabdc3264 is fetched for user 6d966c76275041ad8cb15cceea55f18b. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee5d0ca-4407-4bc5-9694-93fec3b8d85d]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Flow 'volume_create_manager' (61212c6a-f4a6-4bf1-859e-047ceea822d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:46 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:46 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD Sep 29 18:57:46 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cf5ee4-0a2d-4833-99b6-e72ab6c9ea3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68" returned: 0 in 0.526s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23cf5ee4-0a2d-4833-99b6-e72ab6c9ea3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccab7735-0e24-44bf-9a4c-eea5302526c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2131962d4eb24128936524b5347fe318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:46Z,use_quota=True,user_id='c6f3ee024f224a0ebdb1ee2c672fe58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de535310-579e-4a86-bbdf-939f1bfcd998),volume_type_id=de535310-579e-4a86-bbdf-939f1bfcd998)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:46 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68 Sep 29 18:57:46 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907215c6-5ac2-4578-a667-c0a2cdb8f4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (907215c6-5ac2-4578-a667-c0a2cdb8f4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ee127a-75ba-4d8e-b4ab-af73b37c414c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.image.glance [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Creating Keystone auth plugin from conf {{(pid=86523) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 29 18:57:46 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:46 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8203737f-a6d0-40c1-923c-4ef5a40d5a68" returned: 0 in 0.334s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-quobyte-8203737f-a6d0-40c1-923c-4ef5a40d5a68" released by "delete_volume" :: held 0.920s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:46 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD Sep 29 18:57:46 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Created reservations ['ff630116-f089-40c9-a080-b0341bf5d29f', '92b78c93-b3d7-454b-af37-502871baedf1', 'e2e07e6a-f6b6-4be1-ac04-6351d3fdd5a5', '75547ce9-fb32-4678-84b0-71163cfab34c'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5ee127a-75ba-4d8e-b4ab-af73b37c414c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ccab7735-0e24-44bf-9a4c-eea5302526c1', 'volume_name': 'volume-ccab7735-0e24-44bf-9a4c-eea5302526c1', 'volume_size': 1, 'image_id': '0b4f230c-887d-4e75-9afd-597224c456ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b4f230c-887d-4e75-9afd-597224c456ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '200c660619791c55c546473d67d66b32', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2131962d4eb24128936524b5347fe318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '214f725399d621de7170b6b27addfd7b4919da7980e5f263861aa9929bdba18f221ef74c647e13600c87f589a3cc22759a42f6aa2e81448796842d8d60ecbdf2', 'id': '0b4f230c-887d-4e75-9afd-597224c456ad', 'created_at': datetime.datetime(2026, 9, 29, 16, 57, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 57, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b4f230c-887d-4e75-9afd-597224c456ad/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687bb2a4-81f6-4c51-a971-65fc68be8e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:46 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:46 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687bb2a4-81f6-4c51-a971-65fc68be8e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009333ca-2550-4fa6-a00c-79ac88220ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:46 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Volume ccab7735-0e24-44bf-9a4c-eea5302526c1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ccab7735-0e24-44bf-9a4c-eea5302526c1', 'volume_size': 1, 'image_id': '0b4f230c-887d-4e75-9afd-597224c456ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b4f230c-887d-4e75-9afd-597224c456ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '200c660619791c55c546473d67d66b32', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2131962d4eb24128936524b5347fe318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '214f725399d621de7170b6b27addfd7b4919da7980e5f263861aa9929bdba18f221ef74c647e13600c87f589a3cc22759a42f6aa2e81448796842d8d60ecbdf2', 'id': '0b4f230c-887d-4e75-9afd-597224c456ad', 'created_at': datetime.datetime(2026, 9, 29, 16, 57, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 57, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b4f230c-887d-4e75-9afd-597224c456ad/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 29 18:57:46 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Trying to clone ccab7735-0e24-44bf-9a4c-eea5302526c1 from image 0b4f230c-887d-4e75-9afd-597224c456ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/0b4f230c-887d-4e75-9afd-597224c456ad', 'metadata': {}}]). {{(pid=86523) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 29 18:57:47 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Image download 0.00 MB at 0.00 MB/s Sep 29 18:57:47 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD" returned: 1 in 0.403s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c94c922-fb84-4aaa-a8d7-0712e80fd517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b7ff29f3b4947f6b161b5dbe0f8f976',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:44Z,use_quota=True,user_id='6d966c76275041ad8cb15cceea55f18b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Creating volume 4c94c922-fb84-4aaa-a8d7-0712e80fd517 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:47 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:47 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 1073741824 Sep 29 18:57:47 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1a423b-38ca-4129-aff0-3e80278de13b]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:47 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.272s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:47 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Deleted volume successfully. Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5ca8692d-2788-4ca0-8f31-426871610ffe tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-8203737f-a6d0-40c1-923c-4ef5a40d5a68-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:47 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD Sep 29 18:57:47 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:47 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD" returned: 0 in 0.350s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:47 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 1073741824" returned: 0 in 0.472s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:47 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD Sep 29 18:57:47 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:47 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 Sep 29 18:57:47 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:47 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Temporary image 0b4f230c-887d-4e75-9afd-597224c456ad is fetched for user c6f3ee024f224a0ebdb1ee2c672fe58b. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 29 18:57:47 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517" returned: 0 in 0.284s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9932b3be-b9a1-4938-a3a8-f72acff0cd1e]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Attempting download of c2513818-aefe-48f9-9b3d-a8afabdc3264 ((None, [{'url': 'file:///opt/stack/data/glance/images/c2513818-aefe-48f9-9b3d-a8afabdc3264', 'metadata': {}}])) to volume 4c94c922-fb84-4aaa-a8d7-0712e80fd517. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "cinder-dcd3a320-716a-4259-839b-e1c37d5c5e88-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-dcd3a320-716a-4259-839b-e1c37d5c5e88-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f6838d-82a1-4d21-9a2b-04f09519ee32]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2513818-aefe-48f9-9b3d-a8afabdc3264_duinr25o {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:48 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD Sep 29 18:57:48 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "cinder-quobyte-dcd3a320-716a-4259-839b-e1c37d5c5e88" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-quobyte-dcd3a320-716a-4259-839b-e1c37d5c5e88" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:48 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2513818-aefe-48f9-9b3d-a8afabdc3264_duinr25o Sep 29 18:57:48 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3b5759-69b5-4277-bbb5-1101711f51f0]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dcd3a320-716a-4259-839b-e1c37d5c5e88 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:48 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dcd3a320-716a-4259-839b-e1c37d5c5e88 Sep 29 18:57:48 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:48 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:48 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c2513818-aefe-48f9-9b3d-a8afabdc3264_duinr25o" returned: 0 in 0.396s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2513818-aefe-48f9-9b3d-a8afabdc3264_duinr25o {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:48 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD Sep 29 18:57:48 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:48 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2513818-aefe-48f9-9b3d-a8afabdc3264_duinr25o Sep 29 18:57:48 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:48 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dcd3a320-716a-4259-839b-e1c37d5c5e88" returned: 0 in 0.479s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dcd3a320-716a-4259-839b-e1c37d5c5e88 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:48 devstack sudo[107580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dcd3a320-716a-4259-839b-e1c37d5c5e88 Sep 29 18:57:48 devstack sudo[107580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:48 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD" returned: 1 in 0.397s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccab7735-0e24-44bf-9a4c-eea5302526c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2131962d4eb24128936524b5347fe318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:46Z,use_quota=True,user_id='c6f3ee024f224a0ebdb1ee2c672fe58b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de535310-579e-4a86-bbdf-939f1bfcd998),volume_type_id=de535310-579e-4a86-bbdf-939f1bfcd998)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Creating volume ccab7735-0e24-44bf-9a4c-eea5302526c1 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:48 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:48 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 1073741824 Sep 29 18:57:48 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:48 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2513818-aefe-48f9-9b3d-a8afabdc3264_duinr25o" returned: 1 in 0.446s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c2513818-aefe-48f9-9b3d-a8afabdc3264_duinr25o' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f49b88a8-f6eb-44e1-addf-68c7e0d1ddd8]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:48 devstack sudo[107580]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-dcd3a320-716a-4259-839b-e1c37d5c5e88" returned: 0 in 0.310s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-quobyte-dcd3a320-716a-4259-839b-e1c37d5c5e88" released by "delete_volume" :: held 0.868s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:48 devstack sudo[107589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD Sep 29 18:57:48 devstack sudo[107589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Created reservations ['ae7e3333-78eb-465b-8399-d40a53eea781', '733139c8-cf0e-4a31-886d-607fef953dc5', '44d40a6b-e941-4e99-b1d1-d83f20ee9ea7', '45583c55-a2da-4e6b-9df3-8f7ac44f4281'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:49 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:49 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "cinder-3340e125-6b9f-4a38-ba9c-0f94292b5ec2-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-3340e125-6b9f-4a38-ba9c-0f94292b5ec2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "cinder-quobyte-3340e125-6b9f-4a38-ba9c-0f94292b5ec2" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-quobyte-3340e125-6b9f-4a38-ba9c-0f94292b5ec2" acquired by "delete_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[87583b91-34d3-4c5b-8771-41848195e425]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:49 devstack sudo[107589]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD" returned: 0 in 0.470s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:49 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 1073741824" returned: 0 in 0.663s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:49 devstack sudo[107600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2 Sep 29 18:57:49 devstack sudo[107600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:49 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.382s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:49 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Deleted volume successfully. Sep 29 18:57:49 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD Sep 29 18:57:49 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:49 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 Sep 29 18:57:49 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d59c75c9-4dd4-48e6-9842-e2549c4db40e tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-dcd3a320-716a-4259-839b-e1c37d5c5e88-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:49 devstack sudo[107600]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2" returned: 0 in 0.402s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:49 devstack sudo[107614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2 Sep 29 18:57:49 devstack sudo[107614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:49 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD" returned: 1 in 0.421s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] c2513818-aefe-48f9-9b3d-a8afabdc3264 was raw, converting to qcow2 {{(pid=86523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:57:49 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1" returned: 0 in 0.297s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:49 devstack sudo[107616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 Sep 29 18:57:49 devstack sudo[107616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Attempting download of 0b4f230c-887d-4e75-9afd-597224c456ad ((None, [{'url': 'file:///opt/stack/data/glance/images/0b4f230c-887d-4e75-9afd-597224c456ad', 'metadata': {}}])) to volume ccab7735-0e24-44bf-9a4c-eea5302526c1. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7389f2-babf-4a46-8e09-2d8e0238528f]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b4f230c-887d-4e75-9afd-597224c456ad__p7ev7vo {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:50 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b4f230c-887d-4e75-9afd-597224c456ad__p7ev7vo Sep 29 18:57:50 devstack sudo[107614]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3340e125-6b9f-4a38-ba9c-0f94292b5ec2" returned: 0 in 0.338s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:50 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-quobyte-3340e125-6b9f-4a38-ba9c-0f94292b5ec2" released by "delete_volume" :: held 0.797s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Created reservations ['c89643a1-a70e-47ab-9961-dcfbbfd56180', 'c580b4e3-21c6-41f1-a81f-95234679cc1a', 'c2521f84-d0b5-416e-bcf5-e6e413ac6df5', '70ecdd31-55cb-4dc1-bc31-cc790d08ad9b'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:50 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:50 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:50 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b4f230c-887d-4e75-9afd-597224c456ad__p7ev7vo" returned: 0 in 0.433s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b4f230c-887d-4e75-9afd-597224c456ad__p7ev7vo {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:50 devstack sudo[107616]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517" returned: 0 in 0.600s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c2513818-aefe-48f9-9b3d-a8afabdc3264_eqxedll5devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:57:50 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "cinder-38c8da42-578b-4e57-bcb2-a69e4f99f170-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:50 devstack sudo[107630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 1G Sep 29 18:57:50 devstack sudo[107630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-38c8da42-578b-4e57-bcb2-a69e4f99f170-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "cinder-quobyte-38c8da42-578b-4e57-bcb2-a69e4f99f170" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-quobyte-38c8da42-578b-4e57-bcb2-a69e4f99f170" acquired by "delete_volume" :: waited 0.034s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:50 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b4f230c-887d-4e75-9afd-597224c456ad__p7ev7vo Sep 29 18:57:50 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee172aba-4491-46dd-b6c8-770ac6b5290b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38c8da42-578b-4e57-bcb2-a69e4f99f170 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:50 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.433s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:50 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Deleted volume successfully. Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-e87334e6-6d7e-4854-aad0-8037f4ccfe45 tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-3340e125-6b9f-4a38-ba9c-0f94292b5ec2-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:50 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38c8da42-578b-4e57-bcb2-a69e4f99f170 Sep 29 18:57:50 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:50 devstack sudo[107630]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 1G" returned: 0 in 0.504s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Downloaded image c2513818-aefe-48f9-9b3d-a8afabdc3264 ((None, [{'url': 'file:///opt/stack/data/glance/images/c2513818-aefe-48f9-9b3d-a8afabdc3264', 'metadata': {}}])) to volume 4c94c922-fb84-4aaa-a8d7-0712e80fd517 successfully. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Temporary image c2513818-aefe-48f9-9b3d-a8afabdc3264 for user 6d966c76275041ad8cb15cceea55f18b is deleted. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Marking volume 4c94c922-fb84-4aaa-a8d7-0712e80fd517 as bootable. {{(pid=86523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:57:50 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b4f230c-887d-4e75-9afd-597224c456ad__p7ev7vo" returned: 1 in 0.557s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b4f230c-887d-4e75-9afd-597224c456ad__p7ev7vo' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea054be-5209-4372-89ed-47087f7530eb]: (4, 'raw') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Copying metadata from image c2513818-aefe-48f9-9b3d-a8afabdc3264 to 4c94c922-fb84-4aaa-a8d7-0712e80fd517. {{(pid=86523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Creating volume glance metadata for volume 4c94c922-fb84-4aaa-a8d7-0712e80fd517 backed by image c2513818-aefe-48f9-9b3d-a8afabdc3264 with: {'image_id': 'c2513818-aefe-48f9-9b3d-a8afabdc3264', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2bbe76a9f54587ba9333da01b81a0f4c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95737784-1682-42ad-859e-65f1e8aaf742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517', 'volume_size': 1, 'image_id': 'c2513818-aefe-48f9-9b3d-a8afabdc3264', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c2513818-aefe-48f9-9b3d-a8afabdc3264', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2bbe76a9f54587ba9333da01b81a0f4c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0b7ff29f3b4947f6b161b5dbe0f8f976', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7424be42611a1dae0de7460bf159992b04cebb24d0e7d3fca4d0419884ac20d785719446fe4c643caf669e82159442f248043d9a52ce04b65e2a7b5d7f980f55', 'id': 'c2513818-aefe-48f9-9b3d-a8afabdc3264', 'created_at': datetime.datetime(2026, 9, 29, 16, 57, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 57, 43, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c2513818-aefe-48f9-9b3d-a8afabdc3264/file', 'properties': {}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (925b9ce9-6686-4a9a-82f9-6dc4f3354c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:50 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Volume volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 (4c94c922-fb84-4aaa-a8d7-0712e80fd517): created successfully Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (925b9ce9-6686-4a9a-82f9-6dc4f3354c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:50 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Flow 'volume_create_manager' (88775f55-a4fe-4e01-b753-ad478793ebd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:51 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d87157f9-f287-415c-a9e7-f78a203d99f3 tempest-VolumeImageDependencyTests-2088790738 None] Created volume successfully. Sep 29 18:57:51 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD Sep 29 18:57:51 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:51 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38c8da42-578b-4e57-bcb2-a69e4f99f170" returned: 0 in 0.554s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38c8da42-578b-4e57-bcb2-a69e4f99f170 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:51 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38c8da42-578b-4e57-bcb2-a69e4f99f170 Sep 29 18:57:51 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:51 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:51 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD Sep 29 18:57:51 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:51 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-38c8da42-578b-4e57-bcb2-a69e4f99f170" returned: 0 in 0.258s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-quobyte-38c8da42-578b-4e57-bcb2-a69e4f99f170" released by "delete_volume" :: held 0.876s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Created reservations ['0c45c2e7-c119-4d36-ad09-cc013e4e22ad', 'b0da1be1-17bb-4797-a676-b38b3ea9b390', '8a62e8b3-169a-4a4e-99b0-a2aeb6e6a984', '67c096d7-cf6b-4df1-bc50-10080f075d5e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:51 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:51 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "cinder-448fa67e-19d9-4ff3-a056-a38a2bc34f2c-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:51 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] 0b4f230c-887d-4e75-9afd-597224c456ad was raw, converting to qcow2 {{(pid=86523) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-448fa67e-19d9-4ff3-a056-a38a2bc34f2c-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:51 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 Sep 29 18:57:51 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "cinder-quobyte-448fa67e-19d9-4ff3-a056-a38a2bc34f2c" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-quobyte-448fa67e-19d9-4ff3-a056-a38a2bc34f2c" acquired by "delete_volume" :: waited 0.035s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48035b7-48b1-448e-8315-2c73a83aba81]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:51 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.337s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:51 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Deleted volume successfully. Sep 29 18:57:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f400df22-b19a-4e4e-b51b-82587cace95d tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-38c8da42-578b-4e57-bcb2-a69e4f99f170-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:51 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c Sep 29 18:57:51 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Acquiring lock "cinder-4c94c922-fb84-4aaa-a8d7-0712e80fd517-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Lock "cinder-4c94c922-fb84-4aaa-a8d7-0712e80fd517-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Acquiring lock "cinder-quobyte-4c94c922-fb84-4aaa-a8d7-0712e80fd517" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Lock "cinder-quobyte-4c94c922-fb84-4aaa-a8d7-0712e80fd517" acquired by "delete_volume" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e38a47a-bdd1-4224-b960-3dd2663d8afb]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:52 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 Sep 29 18:57:52 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:52 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1" returned: 0 in 0.674s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0b4f230c-887d-4e75-9afd-597224c456ad_smfo6oqndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:57:52 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Converted 0.00 MB image at 0.00 MB/s Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:52 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c" returned: 0 in 0.471s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:52 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 1G Sep 29 18:57:52 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:52 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c Sep 29 18:57:52 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:52 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-448fa67e-19d9-4ff3-a056-a38a2bc34f2c" returned: 0 in 0.265s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-quobyte-448fa67e-19d9-4ff3-a056-a38a2bc34f2c" released by "delete_volume" :: held 0.808s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Created reservations ['d54f221c-816f-413a-87ab-3b3fd1791921', '5f8c61c2-d4d8-4630-804c-619913586d7c', '173c5cc0-8ade-4efc-978b-b9adc7454a12', '0adbeedb-da14-4f80-a2cc-938a5ede8438'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:52 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517" returned: 0 in 0.545s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:52 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517 Sep 29 18:57:52 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:52 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 1G" returned: 0 in 0.505s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Downloaded image 0b4f230c-887d-4e75-9afd-597224c456ad ((None, [{'url': 'file:///opt/stack/data/glance/images/0b4f230c-887d-4e75-9afd-597224c456ad', 'metadata': {}}])) to volume ccab7735-0e24-44bf-9a4c-eea5302526c1 successfully. {{(pid=86523) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Sep 29 18:57:52 devstack sudo[107686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Temporary image 0b4f230c-887d-4e75-9afd-597224c456ad for user c6f3ee024f224a0ebdb1ee2c672fe58b is deleted. {{(pid=86523) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.volume.volume_utils [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Marking volume ccab7735-0e24-44bf-9a4c-eea5302526c1 as bootable. {{(pid=86523) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Sep 29 18:57:52 devstack sudo[107686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Copying metadata from image 0b4f230c-887d-4e75-9afd-597224c456ad to ccab7735-0e24-44bf-9a4c-eea5302526c1. {{(pid=86523) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Creating volume glance metadata for volume ccab7735-0e24-44bf-9a4c-eea5302526c1 backed by image 0b4f230c-887d-4e75-9afd-597224c456ad with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '0b4f230c-887d-4e75-9afd-597224c456ad', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '200c660619791c55c546473d67d66b32', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86523) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (009333ca-2550-4fa6-a00c-79ac88220ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccab7735-0e24-44bf-9a4c-eea5302526c1', 'volume_size': 1, 'image_id': '0b4f230c-887d-4e75-9afd-597224c456ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b4f230c-887d-4e75-9afd-597224c456ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '200c660619791c55c546473d67d66b32', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2131962d4eb24128936524b5347fe318', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '214f725399d621de7170b6b27addfd7b4919da7980e5f263861aa9929bdba18f221ef74c647e13600c87f589a3cc22759a42f6aa2e81448796842d8d60ecbdf2', 'id': '0b4f230c-887d-4e75-9afd-597224c456ad', 'created_at': datetime.datetime(2026, 9, 29, 16, 57, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 29, 16, 57, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b4f230c-887d-4e75-9afd-597224c456ad/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0571e2-4de6-404f-8887-4b8edf6ffc8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:52 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Volume volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 (ccab7735-0e24-44bf-9a4c-eea5302526c1): created successfully Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c0571e2-4de6-404f-8887-4b8edf6ffc8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:52 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Flow 'volume_create_manager' (61212c6a-f4a6-4bf1-859e-047ceea822d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:52 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f08fe7d6-3358-43af-8e0f-9cabb5ea1782 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Created volume successfully. Sep 29 18:57:53 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4c94c922-fb84-4aaa-a8d7-0712e80fd517" returned: 0 in 0.313s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Lock "cinder-quobyte-4c94c922-fb84-4aaa-a8d7-0712e80fd517" released by "delete_volume" :: held 0.907s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Created reservations ['45e1ac3e-c636-4d9c-a189-b11a5a1763d1', 'a66118cf-e8d3-4f4e-abf0-227e55cd176f', '29edf0f9-333a-45bf-b64a-a86765018eb0', '361551bf-0938-4d2a-9a30-fb8506f67a6c'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:53 devstack sudo[107686]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.312s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:53 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Deleted volume successfully. Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2dc67104-f125-4fee-861f-3b485cdde296 tempest-CreateVolumesFromImageTest-866997194 None] Lock "cinder-448fa67e-19d9-4ff3-a056-a38a2bc34f2c-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:53 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:53 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:53 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.294s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:53 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Deleted volume successfully. Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d3805124-53a1-40bf-bd6c-03e2e92af4eb tempest-VolumeImageDependencyTests-2088790738 None] Lock "cinder-4c94c922-fb84-4aaa-a8d7-0712e80fd517-delete_volume" released by "delete_volume" :: held 1.462s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Acquiring lock "cinder-ccab7735-0e24-44bf-9a4c-eea5302526c1-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Lock "cinder-ccab7735-0e24-44bf-9a4c-eea5302526c1-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Acquiring lock "cinder-quobyte-ccab7735-0e24-44bf-9a4c-eea5302526c1" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:57:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Lock "cinder-quobyte-ccab7735-0e24-44bf-9a4c-eea5302526c1" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:57:54 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a5c09f-7425-4138-86ee-da5a3ddd5ef1]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:57:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:54 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 Sep 29 18:57:54 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:54 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1" returned: 0 in 0.511s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:54 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1 Sep 29 18:57:54 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:54 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ccab7735-0e24-44bf-9a4c-eea5302526c1" returned: 0 in 0.382s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Lock "cinder-quobyte-ccab7735-0e24-44bf-9a4c-eea5302526c1" released by "delete_volume" :: held 0.970s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:55 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Created reservations ['a2198439-d3ce-4d64-837f-8c9925010588', 'abfca1bf-4a97-4598-8e3b-65bfc61dbf27', '0e6c6b9f-ccd7-4d2d-892c-fb3f00827bf0', 'bcbef0b0-7ace-41f5-b3ca-5effea232839'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:57:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:55 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:55 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:55 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:55 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:55 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.376s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:55 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:55 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Deleted volume successfully. Sep 29 18:57:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8b7c481c-d00b-4fd1-9869-047d8bfdad33 tempest-VolumeAndVolumeTypeFromImageTest-1304586908 None] Lock "cinder-ccab7735-0e24-44bf-9a4c-eea5302526c1-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Flow 'volume_create_manager' (423bacdc-d280-45ee-95e4-d6e745c5bd1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb037016-3894-4ba9-a333-a0ccc0b966c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb037016-3894-4ba9-a333-a0ccc0b966c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48bba2a89fa4d878180646f87530385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:57Z,use_quota=True,user_id='4dfa010b093245179d7e0ea27aa6a2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d06f6b-592f-4975-96e0-fedd7e3df7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8d06f6b-592f-4975-96e0-fedd7e3df7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3836a0e9-e5fe-44f7-a177-1ffc4bf68f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3836a0e9-e5fe-44f7-a177-1ffc4bf68f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a', 'volume_name': 'volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0c9d40-1a87-4e83-ab75-f8140afc038f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f0c9d40-1a87-4e83-ab75-f8140afc038f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9de7700-cecc-4d8a-899a-513d80921d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:57 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Volume ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a', 'volume_size': 1} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48bba2a89fa4d878180646f87530385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:57Z,use_quota=True,user_id='4dfa010b093245179d7e0ea27aa6a2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Creating volume ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:57 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:57 devstack sudo[107707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a 1073741824 Sep 29 18:57:57 devstack sudo[107707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:58 devstack sudo[107707]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a 1073741824" returned: 0 in 0.632s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:58 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a Sep 29 18:57:58 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Flow 'volume_create_manager' (ad882733-432a-4f45-b470-e3008d4a82ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583c9663-52b5-423f-accb-0b7efc764711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (583c9663-52b5-423f-accb-0b7efc764711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1640606180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1d8f16-83fe-4b60-a7ec-c89d44274aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3355e7de2369413489037b1e333d3346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:58Z,use_quota=True,user_id='f4489742bacc4bbe9be11beca056ed06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e9f96e-6300-4854-9eec-9c7037f0a8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6e9f96e-6300-4854-9eec-9c7037f0a8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abea53d-c7df-427d-bf2c-a21dbe958d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2abea53d-c7df-427d-bf2c-a21dbe958d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a1d8f16-83fe-4b60-a7ec-c89d44274aeb', 'volume_name': 'volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797ee9e8-4a4e-487a-9f6f-03d377361d8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (797ee9e8-4a4e-487a-9f6f-03d377361d8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa121cc4-306b-42dc-8928-b848c4555da6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:58 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Volume 8a1d8f16-83fe-4b60-a7ec-c89d44274aeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb', 'volume_size': 1} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:58 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a" returned: 0 in 0.309s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.110s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:57:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1640606180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a1d8f16-83fe-4b60-a7ec-c89d44274aeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3355e7de2369413489037b1e333d3346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:57:58Z,use_quota=True,user_id='f4489742bacc4bbe9be11beca056ed06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Creating volume 8a1d8f16-83fe-4b60-a7ec-c89d44274aeb {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:57:58 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:58 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb 1073741824 Sep 29 18:57:58 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9de7700-cecc-4d8a-899a-513d80921d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314d6f1e-8b1e-4f3b-9337-27117a6df4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:58 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Volume volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a (ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a): created successfully Sep 29 18:57:58 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (314d6f1e-8b1e-4f3b-9337-27117a6df4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:58 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Flow 'volume_create_manager' (423bacdc-d280-45ee-95e4-d6e745c5bd1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:58 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-bba9eae7-3c62-42cf-b851-595a6545e60b tempest-CinderUnicodeTest-1912564894 None] Created volume successfully. Sep 29 18:57:59 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.394s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:57:59 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb 1073741824" returned: 0 in 0.570s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:57:59 devstack sudo[107725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb Sep 29 18:57:59 devstack sudo[107725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:57:59 devstack sudo[107725]: pam_unix(sudo:session): session closed for user root Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb" returned: 0 in 0.370s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa121cc4-306b-42dc-8928-b848c4555da6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c019434-1549-4721-9ba1-0d50bb527ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:57:59 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Volume volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb (8a1d8f16-83fe-4b60-a7ec-c89d44274aeb): created successfully Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c019434-1549-4721-9ba1-0d50bb527ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:57:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Flow 'volume_create_manager' (ad882733-432a-4f45-b470-e3008d4a82ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:57:59 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-062f5cee-a5b6-4e88-8dc2-c9668018307e tempest-VolumeDependencyTests-252522307 None] Created volume successfully. Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Flow 'volume_create_manager' (37e890f7-c78a-4ea6-badd-f32a70b1e471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6153e0-cdb1-4deb-81ea-fe4e053c993b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d6153e0-cdb1-4deb-81ea-fe4e053c993b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-297078873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d461aed-825a-476c-ade2-fbfc84888ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48bba2a89fa4d878180646f87530385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:00Z,use_quota=True,user_id='4dfa010b093245179d7e0ea27aa6a2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15ddaab-332f-420d-8e99-68fd79f1d2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c15ddaab-332f-420d-8e99-68fd79f1d2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7015f139-288a-45b2-a866-ed089bdaf81b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7015f139-288a-45b2-a866-ed089bdaf81b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d461aed-825a-476c-ade2-fbfc84888ecf', 'volume_name': 'volume-1d461aed-825a-476c-ade2-fbfc84888ecf', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde31584-23dc-49fc-afe2-92eb0bc567bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde31584-23dc-49fc-afe2-92eb0bc567bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb090d9e-3833-4c56-8fe9-6106f7431ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:00 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Volume 1d461aed-825a-476c-ade2-fbfc84888ecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d461aed-825a-476c-ade2-fbfc84888ecf', 'volume_size': 1} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-297078873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d461aed-825a-476c-ade2-fbfc84888ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e48bba2a89fa4d878180646f87530385',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:00Z,use_quota=True,user_id='4dfa010b093245179d7e0ea27aa6a2e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Creating volume 1d461aed-825a-476c-ade2-fbfc84888ecf {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:00 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:00 devstack sudo[107732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf 1073741824 Sep 29 18:58:00 devstack sudo[107732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:01 devstack sudo[107732]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf 1073741824" returned: 0 in 0.599s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:01 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf Sep 29 18:58:01 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:01 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf" returned: 0 in 0.293s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.943s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.742s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] Creating offline snapshot 9086d3fd-316e-4fd8-86cb-af457fd826ca of volume 8a1d8f16-83fe-4b60-a7ec-c89d44274aeb {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb090d9e-3833-4c56-8fe9-6106f7431ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d461aed-825a-476c-ade2-fbfc84888ecf', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a369f5cc-f996-417a-9126-68876015ce1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[85a64ff8-7d34-4df0-8311-8b8cefb0852e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:01 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Volume volume-1d461aed-825a-476c-ade2-fbfc84888ecf (1d461aed-825a-476c-ade2-fbfc84888ecf): created successfully Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a369f5cc-f996-417a-9126-68876015ce1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Flow 'volume_create_manager' (37e890f7-c78a-4ea6-badd-f32a70b1e471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:01 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8de54795-58a1-4ea5-a455-2404480402cc tempest-CinderUnicodeTest-1912564894 None] Created volume successfully. Sep 29 18:58:01 devstack sudo[107744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb Sep 29 18:58:01 devstack sudo[107744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:01 devstack sudo[107744]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb" returned: 0 in 0.452s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:02 devstack sudo[107749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca 1G Sep 29 18:58:02 devstack sudo[107749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:02 devstack sudo[107749]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca 1G" returned: 0 in 0.574s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:02 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca Sep 29 18:58:02 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Flow 'volume_create_manager' (6b41c699-b49c-4917-b279-ee640f99637e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e155ed6-b0d9-49c2-a043-7c7c27f296df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e155ed6-b0d9-49c2-a043-7c7c27f296df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-88444097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6edb16-e44c-4ff3-8df7-2569c2b5ef35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07d74b36a5844b989d32244ddc8c3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:03Z,use_quota=True,user_id='f8f19a5c69ad45bdbd4470ceacce2ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97891d62-c087-4c58-9340-67857e1833bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97891d62-c087-4c58-9340-67857e1833bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b6d688-caba-442b-a125-44567a3d9dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7b6d688-caba-442b-a125-44567a3d9dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd6edb16-e44c-4ff3-8df7-2569c2b5ef35', 'volume_name': 'volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b445bf5d-9983-4091-b37c-dbdfe2f08ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b445bf5d-9983-4091-b37c-dbdfe2f08ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2061fa21-7554-4940-b55c-5acf6e268f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:02 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume bd6edb16-e44c-4ff3-8df7-2569c2b5ef35: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35', 'volume_size': 1} Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:02 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca" returned: 0 in 0.394s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:02 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca is being set with open permissions: ugo+rw Sep 29 18:58:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:02 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca Sep 29 18:58:02 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:03 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca" returned: 0 in 0.251s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:03 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.info Sep 29 18:58:03 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:03 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.info" returned: 0 in 0.257s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:03 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.info is being set with open permissions: ugo+rw Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:03 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.info Sep 29 18:58:03 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:03 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.info" returned: 0 in 0.239s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.263s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-88444097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd6edb16-e44c-4ff3-8df7-2569c2b5ef35,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07d74b36a5844b989d32244ddc8c3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:03Z,use_quota=True,user_id='f8f19a5c69ad45bdbd4470ceacce2ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Creating volume bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:03 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:03 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 1073741824 Sep 29 18:58:03 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:03 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-5e7daac2-9faf-4a6e-8cd8-b1f58f676e33 tempest-VolumeDependencyTests-252522307 None] Create snapshot completed successfully Sep 29 18:58:04 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 1073741824" returned: 0 in 0.536s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:04 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 Sep 29 18:58:04 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Flow 'volume_create_manager' (aaa52064-741f-4e5c-b48d-55d66a5adf67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f70101-6644-48bb-837e-1a65d35e9269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13f70101-6644-48bb-837e-1a65d35e9269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1045552089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72d701d-0421-41c0-abfe-7fe6b2055dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3355e7de2369413489037b1e333d3346',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=9086d3fd-316e-4fd8-86cb-af457fd826ca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:05Z,use_quota=True,user_id='f4489742bacc4bbe9be11beca056ed06',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a317b39-b024-4db8-8138-19bbe9ceba36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a317b39-b024-4db8-8138-19bbe9ceba36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e1e785-2350-47eb-8263-3f6c6c9c8ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e1e785-2350-47eb-8263-3f6c6c9c8ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f72d701d-0421-41c0-abfe-7fe6b2055dda', 'volume_name': 'volume-f72d701d-0421-41c0-abfe-7fe6b2055dda', 'volume_size': 1, 'snapshot_id': '9086d3fd-316e-4fd8-86cb-af457fd826ca'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5074dfd-452b-43fe-85fb-dbadd84b0804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5074dfd-452b-43fe-85fb-dbadd84b0804) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a229178-3b21-4a0f-bf95-077b87cee20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:04 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Volume f72d701d-0421-41c0-abfe-7fe6b2055dda: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f72d701d-0421-41c0-abfe-7fe6b2055dda', 'volume_size': 1, 'snapshot_id': '9086d3fd-316e-4fd8-86cb-af457fd826ca'} Sep 29 18:58:04 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35" returned: 0 in 0.322s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.882s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] Creating offline snapshot 5db627f1-81a8-415b-805a-a9370fc19865 of volume 1d461aed-825a-476c-ade2-fbfc84888ecf {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2061fa21-7554-4940-b55c-5acf6e268f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956ab1a6-fbb0-43b3-881a-fdd115d2d194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b7d7be0-dfbe-45df-9257-51d5922749ca]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:04 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 (bd6edb16-e44c-4ff3-8df7-2569c2b5ef35): created successfully Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (956ab1a6-fbb0-43b3-881a-fdd115d2d194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Flow 'volume_create_manager' (6b41c699-b49c-4917-b279-ee640f99637e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:04 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6d2bdcfc-ea59-4f78-ae83-7529cc38be3d tempest-CreateVolumesFromSnapshotTest-2041147618 None] Created volume successfully. Sep 29 18:58:04 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf Sep 29 18:58:04 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:05 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf" returned: 0 in 0.408s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:05 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 1G Sep 29 18:58:05 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:05 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 1G" returned: 0 in 0.460s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d461aed-825a-476c-ade2-fbfc84888ecf -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:05 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d461aed-825a-476c-ade2-fbfc84888ecf -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 Sep 29 18:58:05 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:05 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d461aed-825a-476c-ade2-fbfc84888ecf -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865" returned: 0 in 0.351s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:05 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 is being set with open permissions: ugo+rw Sep 29 18:58:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:05 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 Sep 29 18:58:05 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:06 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865" returned: 0 in 0.248s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:06 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.info Sep 29 18:58:06 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:06 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.info" returned: 0 in 0.266s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:06 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.info is being set with open permissions: ugo+rw Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:06 devstack sudo[107836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.info Sep 29 18:58:06 devstack sudo[107836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:06 devstack sudo[107836]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.info" returned: 0 in 0.255s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.092s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.094s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "cinder-quobyte-9086d3fd-316e-4fd8-86cb-af457fd826ca-f72d701d-0421-41c0-abfe-7fe6b2055dda" by "_create_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-quobyte-9086d3fd-316e-4fd8-86cb-af457fd826ca-f72d701d-0421-41c0-abfe-7fe6b2055dda" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Creating volume f72d701d-0421-41c0-abfe-7fe6b2055dda from snapshot 9086d3fd-316e-4fd8-86cb-af457fd826ca {{(pid=86523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "cinder-quobyte-f72d701d-0421-41c0-abfe-7fe6b2055dda" by "_copy_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:06 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4cd1ab06-a903-4dfa-9710-28a8ccdf6560 tempest-CinderUnicodeTest-1912564894 None] Create snapshot completed successfully Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-quobyte-f72d701d-0421-41c0-abfe-7fe6b2055dda" acquired by "_copy_volume_from_snapshot" :: waited 0.032s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] snapshot: 9086d3fd-316e-4fd8-86cb-af457fd826ca, volume: f72d701d-0421-41c0-abfe-7fe6b2055dda, {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6d8290-e487-4ba1-9703-fc7c78fb2254]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "cinder-5db627f1-81a8-415b-805a-a9370fc19865-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-5db627f1-81a8-415b-805a-a9370fc19865-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:07 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca Sep 29 18:58:07 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "cinder-quobyte-1d461aed-825a-476c-ade2-fbfc84888ecf" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-quobyte-1d461aed-825a-476c-ade2-fbfc84888ecf" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "cinder-quobyte-5db627f1-81a8-415b-805a-a9370fc19865" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-quobyte-5db627f1-81a8-415b-805a-a9370fc19865" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Deleting offline snapshot 5db627f1-81a8-415b-805a-a9370fc19865 of volume 1d461aed-825a-476c-ade2-fbfc84888ecf {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] snapshot_file for this snap is: volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b24fea42-8d42-41a0-b3a6-a678e9f533bb]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:07 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 Sep 29 18:58:07 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:07 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca" returned: 0 in 0.426s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[316fa971-b4a6-4043-88c3-c95e68ab848c]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:07 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb Sep 29 18:58:07 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:07 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865" returned: 0 in 0.439s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d461aed-825a-476c-ade2-fbfc84888ecf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f9f1014-6927-4d69-9874-e1fef2e2957e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:07 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf Sep 29 18:58:07 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:07 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb" returned: 0 in 0.418s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Creating direct copy from snapshot {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG cinder.utils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Path /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda not found in is_blk_device check {{(pid=86523) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:58:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:07 devstack sudo[107856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda Sep 29 18:58:07 devstack sudo[107856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:08 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf" returned: 0 in 0.389s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:08 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 Sep 29 18:58:08 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:08 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865" returned: 0 in 0.476s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:08 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865 Sep 29 18:58:08 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:09 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf.5db627f1-81a8-415b-805a-a9370fc19865" returned: 0 in 0.525s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-quobyte-5db627f1-81a8-415b-805a-a9370fc19865" released by "_delete_snapshot" :: held 2.045s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-quobyte-1d461aed-825a-476c-ade2-fbfc84888ecf" released by "delete_snapshot" :: held 2.074s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:09 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Created reservations ['e052f7b0-b544-4070-a0e6-cbb03ecc3886', '00c5a29b-8062-435f-811a-df965f3f2c03', '984d1b66-dd52-4f67-8e9c-2d3147c98ae1', 'f748eef6-8e9d-4061-92a1-b4bae8ccb5ec'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:09 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Delete snapshot completed successfully. Sep 29 18:58:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-629e3589-b057-4fa1-b678-5c9d2cdf51af tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-5db627f1-81a8-415b-805a-a9370fc19865-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "cinder-1d461aed-825a-476c-ade2-fbfc84888ecf-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-1d461aed-825a-476c-ade2-fbfc84888ecf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "cinder-quobyte-1d461aed-825a-476c-ade2-fbfc84888ecf" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-quobyte-1d461aed-825a-476c-ade2-fbfc84888ecf" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1a8100-110c-49fb-894b-2e0c6be6187d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Flow 'volume_create_manager' (0be38379-0818-4d2b-8253-dc4a1faa3693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139812af-9155-436f-93b9-a6e5e63b6e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:10 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf Sep 29 18:58:10 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (139812af-9155-436f-93b9-a6e5e63b6e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-731621384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c37cce-c6e7-4789-8a80-162b52e4c80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f66bf409aa4cffaee6b5c2e7978d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:11Z,use_quota=True,user_id='4eae27e656fd4b418124f21aa8f6be74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d82c04-18c6-4cbf-b920-e78b401dea0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55d82c04-18c6-4cbf-b920-e78b401dea0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4f0c40-3fc3-4d0a-aaeb-90db9a63b727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f4f0c40-3fc3-4d0a-aaeb-90db9a63b727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3c37cce-c6e7-4789-8a80-162b52e4c80e', 'volume_name': 'volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:10 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81b09be-e25c-449c-832f-939a6da91204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f81b09be-e25c-449c-832f-939a6da91204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9146de5d-61a8-46ce-8de7-47cbb97d92a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:11 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Volume c3c37cce-c6e7-4789-8a80-162b52e4c80e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e', 'volume_size': 1} Sep 29 18:58:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:11 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf" returned: 0 in 0.673s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:11 devstack sudo[107886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf Sep 29 18:58:11 devstack sudo[107886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:11 devstack sudo[107886]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-1d461aed-825a-476c-ade2-fbfc84888ecf" returned: 0 in 0.417s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-quobyte-1d461aed-825a-476c-ade2-fbfc84888ecf" released by "delete_volume" :: held 1.232s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:11 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Created reservations ['a03a7d07-8f33-4e9b-850c-f976f64a64dd', '29ca4b96-6a0d-4d8b-aa93-94dedc2fe6fb', '795ea418-2d07-4413-8b8a-1a087f23ed10', 'a54704f7-f88b-4690-a409-a93aa867b745'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:12 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:12 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "cinder-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "cinder-quobyte-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-quobyte-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a" acquired by "delete_volume" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f6e20b3-97e7-4437-95ff-1ad656037a8d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:12 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a Sep 29 18:58:12 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:12 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.516s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:12 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Deleted volume successfully. Sep 29 18:58:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-95f6b3d6-4854-48dc-b81d-846dad538b64 tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-1d461aed-825a-476c-ade2-fbfc84888ecf-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:13 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a" returned: 0 in 0.624s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:13 devstack sudo[107897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a Sep 29 18:58:13 devstack sudo[107897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:13 devstack sudo[107897]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a" returned: 0 in 0.501s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:13 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-quobyte-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a" released by "delete_volume" :: held 1.224s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:13 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Created reservations ['28d17d2d-1000-41cb-a5bb-0cef15383beb', '761c77c0-1cf2-4f0d-999a-b03d0036491c', '4918dda9-6643-4fa8-a4b9-78c7e0602700', '3cea893e-8fa4-432c-899a-09d8b080ed46'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:13 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:13 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:13 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:14 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:14 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.374s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:14 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:14 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Deleted volume successfully. Sep 29 18:58:14 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a6a14701-7b93-4ba2-a8b6-0fed7eaa1af3 tempest-CinderUnicodeTest-1912564894 None] Lock "cinder-ca044dd9-0c9f-4ea1-b7a6-62b235a99e2a-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:15 devstack sudo[107856]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda" returned: 0 in 7.577s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb, size 1024.00 MB, duration 7.58 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:58:15 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Converted 1024.00 MB image at 135.13 MB/s Sep 29 18:58:15 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda is being set with open permissions: ugo+rw Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:15 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda Sep 29 18:58:15 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:15 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda" returned: 0 in 0.249s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-quobyte-f72d701d-0421-41c0-abfe-7fe6b2055dda" released by "_copy_volume_from_snapshot" :: held 8.793s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-quobyte-9086d3fd-316e-4fd8-86cb-af457fd826ca-f72d701d-0421-41c0-abfe-7fe6b2055dda" released by "_create_volume_from_snapshot" :: held 8.883s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.912s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.836s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Creating offline snapshot ac5431d1-335a-40cb-80be-e8f51b298b00 of volume bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a229178-3b21-4a0f-bf95-077b87cee20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f72d701d-0421-41c0-abfe-7fe6b2055dda', 'volume_size': 1, 'snapshot_id': '9086d3fd-316e-4fd8-86cb-af457fd826ca'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11821ab-a63e-40e1-a042-7863f923c9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2e8d03-42e1-400f-9971-622bca276ec4]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:15 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Volume volume-f72d701d-0421-41c0-abfe-7fe6b2055dda (f72d701d-0421-41c0-abfe-7fe6b2055dda): created successfully Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11821ab-a63e-40e1-a042-7863f923c9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:15 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Flow 'volume_create_manager' (aaa52064-741f-4e5c-b48d-55d66a5adf67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:15 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-694c92f1-cdad-4ad5-9fc2-86a907b50b64 tempest-VolumeDependencyTests-252522307 None] Created volume successfully. Sep 29 18:58:15 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 Sep 29 18:58:15 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:16 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35" returned: 0 in 0.410s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:16 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 1G Sep 29 18:58:16 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "cinder-9086d3fd-316e-4fd8-86cb-af457fd826ca-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:16 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 1G" returned: 0 in 0.465s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-9086d3fd-316e-4fd8-86cb-af457fd826ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "cinder-quobyte-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-quobyte-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "cinder-quobyte-9086d3fd-316e-4fd8-86cb-af457fd826ca" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:16 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 Sep 29 18:58:16 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-quobyte-9086d3fd-316e-4fd8-86cb-af457fd826ca" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Deleting offline snapshot 9086d3fd-316e-4fd8-86cb-af457fd826ca of volume 8a1d8f16-83fe-4b60-a7ec-c89d44274aeb {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] snapshot_file for this snap is: volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5409e2f1-e770-4697-aaf2-188cf1321ea1]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:16 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca Sep 29 18:58:16 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:16 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00" returned: 0 in 0.331s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:16 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 is being set with open permissions: ugo+rw Sep 29 18:58:16 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:17 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 Sep 29 18:58:17 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:17 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca" returned: 0 in 0.386s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e8335d-7b3d-46ba-8354-8a9cf83f3644]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:17 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00" returned: 0 in 0.288s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:17 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb Sep 29 18:58:17 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:17 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.info Sep 29 18:58:17 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:17 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.info" returned: 0 in 0.281s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:17 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.info is being set with open permissions: ugo+rw Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:17 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.info Sep 29 18:58:17 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:17 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb" returned: 0 in 0.588s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:17 devstack sudo[107942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca Sep 29 18:58:17 devstack sudo[107942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:17 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.info" returned: 0 in 0.292s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.893s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-731621384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3c37cce-c6e7-4789-8a80-162b52e4c80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f66bf409aa4cffaee6b5c2e7978d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:11Z,use_quota=True,user_id='4eae27e656fd4b418124f21aa8f6be74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Creating volume c3c37cce-c6e7-4789-8a80-162b52e4c80e {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:17 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:17 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:17 devstack sudo[107945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e 1073741824 Sep 29 18:58:17 devstack sudo[107945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:17 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-dea17142-1f12-4661-94a2-ff5459961330 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Create snapshot completed successfully Sep 29 18:58:18 devstack sudo[107942]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca" returned: 0 in 0.383s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:18 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca Sep 29 18:58:18 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:18 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:18 devstack sudo[107945]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb.9086d3fd-316e-4fd8-86cb-af457fd826ca" returned: 0 in 0.302s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e 1073741824" returned: 0 in 0.520s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-quobyte-9086d3fd-316e-4fd8-86cb-af457fd826ca" released by "_delete_snapshot" :: held 1.819s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-quobyte-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb" released by "delete_snapshot" :: held 1.854s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:18 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e Sep 29 18:58:18 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Created reservations ['9d52b246-1b15-40be-bc13-4114803b23b3', '97f195b6-900c-48f3-a947-17c020776977', '9be269d8-efd5-4c98-8635-69d21c5223bc', '91a2d6ff-eead-41bc-afb4-ef61505bee15'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:18 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Delete snapshot completed successfully. Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2df8a35e-5bef-4355-90f2-d491b6e8b1e7 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-9086d3fd-316e-4fd8-86cb-af457fd826ca-delete_snapshot" released by "delete_snapshot" :: held 2.025s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:18 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e" returned: 0 in 0.328s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9146de5d-61a8-46ce-8de7-47cbb97d92a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f034fa7c-a282-4561-ada4-be186fd65746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:18 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Volume volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e (c3c37cce-c6e7-4789-8a80-162b52e4c80e): created successfully Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f034fa7c-a282-4561-ada4-be186fd65746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Flow 'volume_create_manager' (0be38379-0818-4d2b-8253-dc4a1faa3693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:18 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6114c939-7bc4-4a24-ac8b-1f106de9300f tempest-ProjectReaderTests-1837953543 None] Created volume successfully. Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Flow 'volume_create_manager' (edb5d989-0e1b-4991-90af-56f31dd88209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1949f4-56db-4123-9e7b-29ba148b10d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "cinder-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e1949f4-56db-4123-9e7b-29ba148b10d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879841813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b2971e-a30b-43ad-a072-01289c286c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07d74b36a5844b989d32244ddc8c3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:19Z,use_quota=True,user_id='f8f19a5c69ad45bdbd4470ceacce2ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d42daa-a4f5-430a-adc0-5ff8b31c28d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50d42daa-a4f5-430a-adc0-5ff8b31c28d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82108568-9db0-4212-b95c-3ad296307c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82108568-9db0-4212-b95c-3ad296307c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42b2971e-a30b-43ad-a072-01289c286c50', 'volume_name': 'volume-42b2971e-a30b-43ad-a072-01289c286c50', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9937ab-e9ce-4d1c-8415-77c25f8db70e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d9937ab-e9ce-4d1c-8415-77c25f8db70e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41279db-ced9-416e-bb6c-2c909f713b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:19 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume 42b2971e-a30b-43ad-a072-01289c286c50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42b2971e-a30b-43ad-a072-01289c286c50', 'volume_size': 1} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-879841813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42b2971e-a30b-43ad-a072-01289c286c50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07d74b36a5844b989d32244ddc8c3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:19Z,use_quota=True,user_id='f8f19a5c69ad45bdbd4470ceacce2ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Creating volume 42b2971e-a30b-43ad-a072-01289c286c50 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:19 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-42b2971e-a30b-43ad-a072-01289c286c50 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:19 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-42b2971e-a30b-43ad-a072-01289c286c50 1073741824 Sep 29 18:58:19 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "cinder-quobyte-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-quobyte-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb" acquired by "delete_volume" :: waited 0.031s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a610f916-f7ec-4939-b3f9-27032515bd9d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:19 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb Sep 29 18:58:19 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Flow 'volume_create_manager' (230f83a8-86d5-4c1a-a9cf-6d6b8ef0c29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae616a0-16b6-4a07-9d7d-bab165f9f127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Acquiring lock "cinder-c3c37cce-c6e7-4789-8a80-162b52e4c80e-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:19 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-42b2971e-a30b-43ad-a072-01289c286c50 1073741824" returned: 0 in 0.675s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae616a0-16b6-4a07-9d7d-bab165f9f127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-443494000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445288a6-d93d-40a2-9765-70102e03717e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07d74b36a5844b989d32244ddc8c3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:20Z,use_quota=True,user_id='f8f19a5c69ad45bdbd4470ceacce2ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4381b9e-9ec2-447f-aa8a-d4edea61842e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4381b9e-9ec2-447f-aa8a-d4edea61842e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9490bca-3069-40eb-be70-82bfc00ecc23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9490bca-3069-40eb-be70-82bfc00ecc23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '445288a6-d93d-40a2-9765-70102e03717e', 'volume_name': 'volume-445288a6-d93d-40a2-9765-70102e03717e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ca0d0e-2b2f-4b78-8b31-9c773c3c0943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3ca0d0e-2b2f-4b78-8b31-9c773c3c0943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5209f066-c844-4417-b47c-ba7d2e3f749e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:20 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume 445288a6-d93d-40a2-9765-70102e03717e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-445288a6-d93d-40a2-9765-70102e03717e', 'volume_size': 1} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Lock "cinder-c3c37cce-c6e7-4789-8a80-162b52e4c80e-delete_volume" acquired by "delete_volume" :: waited 0.160s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-42b2971e-a30b-43ad-a072-01289c286c50 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:20 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-42b2971e-a30b-43ad-a072-01289c286c50 Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Acquiring lock "cinder-quobyte-c3c37cce-c6e7-4789-8a80-162b52e4c80e" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:20 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Lock "cinder-quobyte-c3c37cce-c6e7-4789-8a80-162b52e4c80e" acquired by "delete_volume" :: waited 0.041s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3773cb98-29cd-4db8-83cb-293415ac4c92]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:20 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb" returned: 0 in 0.747s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:20 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb Sep 29 18:58:20 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:20 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-42b2971e-a30b-43ad-a072-01289c286c50" returned: 0 in 0.388s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] <== create_volume: return (1261ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:20 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e Sep 29 18:58:20 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-443494000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=445288a6-d93d-40a2-9765-70102e03717e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07d74b36a5844b989d32244ddc8c3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:20Z,use_quota=True,user_id='f8f19a5c69ad45bdbd4470ceacce2ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Creating volume 445288a6-d93d-40a2-9765-70102e03717e {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:20 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-445288a6-d93d-40a2-9765-70102e03717e 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d41279db-ced9-416e-bb6c-2c909f713b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42b2971e-a30b-43ad-a072-01289c286c50', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b9d5ca-4cdd-4108-96a8-43776835f4b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:20 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-445288a6-d93d-40a2-9765-70102e03717e 1073741824 Sep 29 18:58:20 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Flow 'volume_create_manager' (d5dcba76-5070-43ae-bd00-b242c022f058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1bfe0c-6cbe-41e4-b327-bd7068184f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1bfe0c-6cbe-41e4-b327-bd7068184f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-508885830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510c547a-8fa9-4e11-849c-70644cab8078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07d74b36a5844b989d32244ddc8c3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:20Z,use_quota=True,user_id='f8f19a5c69ad45bdbd4470ceacce2ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb1647c-14d4-4632-ab77-2a5a80e36b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afb1647c-14d4-4632-ab77-2a5a80e36b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7af6f9b-6ba2-4775-87e5-96f36dd2c902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7af6f9b-6ba2-4775-87e5-96f36dd2c902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '510c547a-8fa9-4e11-849c-70644cab8078', 'volume_name': 'volume-510c547a-8fa9-4e11-849c-70644cab8078', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3a3445-4b54-420f-bc8b-67e8236bc2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea3a3445-4b54-420f-bc8b-67e8236bc2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f58452-4a76-4062-a388-6f489163e703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:20 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume 510c547a-8fa9-4e11-849c-70644cab8078: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-510c547a-8fa9-4e11-849c-70644cab8078', 'volume_size': 1} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:20 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume volume-42b2971e-a30b-43ad-a072-01289c286c50 (42b2971e-a30b-43ad-a072-01289c286c50): created successfully Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3b9d5ca-4cdd-4108-96a8-43776835f4b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Flow 'volume_create_manager' (edb5d989-0e1b-4991-90af-56f31dd88209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-dfe68c4c-c640-4975-921a-66d02ad09703 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Created volume successfully. Sep 29 18:58:20 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb" returned: 0 in 0.638s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-quobyte-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb" released by "delete_volume" :: held 1.582s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:20 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Flow 'volume_create_manager' (fe6232c4-9725-405d-83ec-99204a76a488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a801f9c2-c971-47bf-bd37-8e410f1ae538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a801f9c2-c971-47bf-bd37-8e410f1ae538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1325609453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c65b48f7-352a-4202-afe5-f16c04123cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07d74b36a5844b989d32244ddc8c3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:21Z,use_quota=True,user_id='f8f19a5c69ad45bdbd4470ceacce2ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1547faa4-7531-4fc0-ad8c-c5b640da76aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:21 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1547faa4-7531-4fc0-ad8c-c5b640da76aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7384fb67-ce9c-4531-92f9-f5caf1acaf60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7384fb67-ce9c-4531-92f9-f5caf1acaf60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c65b48f7-352a-4202-afe5-f16c04123cdd', 'volume_name': 'volume-c65b48f7-352a-4202-afe5-f16c04123cdd', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95790752-d751-4a23-9056-3fde02d216d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95790752-d751-4a23-9056-3fde02d216d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1622ce81-535f-49d8-8f0c-9ae3466e678d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:21 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume c65b48f7-352a-4202-afe5-f16c04123cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c65b48f7-352a-4202-afe5-f16c04123cdd', 'volume_size': 1} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e" returned: 0 in 0.898s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:21 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e Sep 29 18:58:21 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Created reservations ['4860c9ff-1b0b-4c78-a861-c0b44a5f55d5', '40a6bb08-8daf-4858-a892-02f83bf4fd63', 'de55bb10-86d4-4cb9-a6d6-6e50d9de0b5c', '6436dca7-7a15-466d-9b9d-605e0cc1ca4e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:21 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-445288a6-d93d-40a2-9765-70102e03717e 1073741824" returned: 0 in 0.679s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-445288a6-d93d-40a2-9765-70102e03717e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:21 devstack sudo[107992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-445288a6-d93d-40a2-9765-70102e03717e Sep 29 18:58:21 devstack sudo[107992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:21 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:21 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:21 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "cinder-f72d701d-0421-41c0-abfe-7fe6b2055dda-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c3c37cce-c6e7-4789-8a80-162b52e4c80e" returned: 0 in 0.452s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-f72d701d-0421-41c0-abfe-7fe6b2055dda-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Lock "cinder-quobyte-c3c37cce-c6e7-4789-8a80-162b52e4c80e" released by "delete_volume" :: held 1.469s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:21 devstack sudo[107992]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Flow 'volume_create_manager' (fa4f9ada-26d2-4437-9a5c-4934fe71fb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df716fad-a407-4dc9-8c4b-809928c92f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-445288a6-d93d-40a2-9765-70102e03717e" returned: 0 in 0.476s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.991s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-508885830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=510c547a-8fa9-4e11-849c-70644cab8078,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07d74b36a5844b989d32244ddc8c3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:20Z,use_quota=True,user_id='f8f19a5c69ad45bdbd4470ceacce2ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Creating volume 510c547a-8fa9-4e11-849c-70644cab8078 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:21 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-510c547a-8fa9-4e11-849c-70644cab8078 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df716fad-a407-4dc9-8c4b-809928c92f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1405282074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07d74b36a5844b989d32244ddc8c3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:22Z,use_quota=True,user_id='f8f19a5c69ad45bdbd4470ceacce2ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:21 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e372ffaa-feb5-459d-a500-0a8c8617ed6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:21 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-510c547a-8fa9-4e11-849c-70644cab8078 1073741824 Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e372ffaa-feb5-459d-a500-0a8c8617ed6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:21 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028079cd-edcf-46e2-856c-7b2cf8ef68e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028079cd-edcf-46e2-856c-7b2cf8ef68e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd89a4ef4-b5ae-4fbf-aa1a-6270e127d29a', 'volume_name': 'volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a46b32c-f1dc-45ac-9034-f90bee6f17f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a46b32c-f1dc-45ac-9034-f90bee6f17f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66dc546-6749-4beb-8c62-8e821a029e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:21 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a', 'volume_size': 1} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "cinder-quobyte-f72d701d-0421-41c0-abfe-7fe6b2055dda" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5209f066-c844-4417-b47c-ba7d2e3f749e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-445288a6-d93d-40a2-9765-70102e03717e', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8a9184-4de4-47f8-8231-977d214bddbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.502s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:21 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Deleted volume successfully. Sep 29 18:58:21 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume volume-445288a6-d93d-40a2-9765-70102e03717e (445288a6-d93d-40a2-9765-70102e03717e): created successfully Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e8a9184-4de4-47f8-8231-977d214bddbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Flow 'volume_create_manager' (230f83a8-86d5-4c1a-a9cf-6d6b8ef0c29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-quobyte-f72d701d-0421-41c0-abfe-7fe6b2055dda" acquired by "delete_volume" :: waited 0.071s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:21 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-05b274b6-a5ea-4198-863d-fc4bd1a68024 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Created volume successfully. Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9613a9c7-cc20-4cb5-9d99-975b7dcb4af6 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-8a1d8f16-83fe-4b60-a7ec-c89d44274aeb-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc13261-dcd0-4160-9f13-0b21850d87ee]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:21 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Created reservations ['a7459bbe-288f-4dd4-bb61-bd6a9cd1bf96', '49151b10-d730-46bd-b62f-f1619d04c8dd', '9e12e769-d9da-45e2-b8ea-ab3b0dd22432', '5a7842a7-aadd-4797-be11-3de20f9ab861'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:22 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:22 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:22 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda Sep 29 18:58:22 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:22 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-510c547a-8fa9-4e11-849c-70644cab8078 1073741824" returned: 0 in 0.627s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:22 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.341s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:22 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Deleted volume successfully. Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-510c547a-8fa9-4e11-849c-70644cab8078 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:22 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-510c547a-8fa9-4e11-849c-70644cab8078 Sep 29 18:58:22 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2f94bdc4-454c-41da-8cbe-72228683a1d7 tempest-ProjectReaderTests-1837953543 None] Lock "cinder-c3c37cce-c6e7-4789-8a80-162b52e4c80e-delete_volume" released by "delete_volume" :: held 2.423s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:22 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda" returned: 0 in 0.574s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:22 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda Sep 29 18:58:22 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:22 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Flow 'volume_create_manager' (ec684480-93ca-428b-8302-fcba52ec6280) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad16fcc5-2004-4246-a32d-650a0e2b1fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-510c547a-8fa9-4e11-849c-70644cab8078" returned: 0 in 0.505s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] <== create_volume: return (1191ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.830s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1325609453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c65b48f7-352a-4202-afe5-f16c04123cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07d74b36a5844b989d32244ddc8c3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:21Z,use_quota=True,user_id='f8f19a5c69ad45bdbd4470ceacce2ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Creating volume c65b48f7-352a-4202-afe5-f16c04123cdd {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:22 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c65b48f7-352a-4202-afe5-f16c04123cdd 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:22 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad16fcc5-2004-4246-a32d-650a0e2b1fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904862489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c2aba6-2223-4869-8b5d-9e093462220f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f66bf409aa4cffaee6b5c2e7978d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:23Z,use_quota=True,user_id='4eae27e656fd4b418124f21aa8f6be74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:22 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c65b48f7-352a-4202-afe5-f16c04123cdd 1073741824 Sep 29 18:58:22 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38445c89-7c1d-4444-bfe8-0e2e3af0024d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38445c89-7c1d-4444-bfe8-0e2e3af0024d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:22 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5795eb0-d62d-452e-9a69-5ef4433c5e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5795eb0-d62d-452e-9a69-5ef4433c5e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50c2aba6-2223-4869-8b5d-9e093462220f', 'volume_name': 'volume-50c2aba6-2223-4869-8b5d-9e093462220f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e06cc73-5cd3-47fb-b079-f26c3de0d0fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e06cc73-5cd3-47fb-b079-f26c3de0d0fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d683fb-8edc-48e8-80af-43d70fcf6ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:23 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Volume 50c2aba6-2223-4869-8b5d-9e093462220f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50c2aba6-2223-4869-8b5d-9e093462220f', 'volume_size': 1} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f72d701d-0421-41c0-abfe-7fe6b2055dda" returned: 0 in 0.485s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11f58452-4a76-4062-a388-6f489163e703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-510c547a-8fa9-4e11-849c-70644cab8078', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08fb7fe-c3bd-44a4-b5c3-413769edc394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-quobyte-f72d701d-0421-41c0-abfe-7fe6b2055dda" released by "delete_volume" :: held 1.152s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:23 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume volume-510c547a-8fa9-4e11-849c-70644cab8078 (510c547a-8fa9-4e11-849c-70644cab8078): created successfully Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e08fb7fe-c3bd-44a4-b5c3-413769edc394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Flow 'volume_create_manager' (d5dcba76-5070-43ae-bd00-b242c022f058) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:23 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8e6a2a8e-c1d9-4868-8b0d-16641538ef2c tempest-CreateVolumesFromSnapshotTest-2041147618 None] Created volume successfully. Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Created reservations ['85928d56-4953-4a03-9000-4a4b45a605d3', '1e551d9e-6d10-40c2-a3a5-f25798d5120b', 'eb5d4268-642f-4f4d-855d-ab614af872a5', 'a0b76500-fb30-4381-80cd-bf932315a823'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:23 devstack sudo[108023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:23 devstack sudo[108023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:23 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c65b48f7-352a-4202-afe5-f16c04123cdd 1073741824" returned: 0 in 0.497s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c65b48f7-352a-4202-afe5-f16c04123cdd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:23 devstack sudo[108023]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.307s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:23 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c65b48f7-352a-4202-afe5-f16c04123cdd Sep 29 18:58:23 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:23 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Deleted volume successfully. Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d7064a87-2083-4186-b168-b769679406a5 tempest-VolumeDependencyTests-252522307 None] Lock "cinder-f72d701d-0421-41c0-abfe-7fe6b2055dda-delete_volume" released by "delete_volume" :: held 1.927s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:23 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c65b48f7-352a-4202-afe5-f16c04123cdd" returned: 0 in 0.279s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.952s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1405282074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b07d74b36a5844b989d32244ddc8c3a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:22Z,use_quota=True,user_id='f8f19a5c69ad45bdbd4470ceacce2ce0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Creating volume d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:23 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:23 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a 1073741824 Sep 29 18:58:23 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1622ce81-535f-49d8-8f0c-9ae3466e678d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c65b48f7-352a-4202-afe5-f16c04123cdd', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fa15e7-ff3d-4ad9-a7ac-d046ffefabaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:23 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume volume-c65b48f7-352a-4202-afe5-f16c04123cdd (c65b48f7-352a-4202-afe5-f16c04123cdd): created successfully Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67fa15e7-ff3d-4ad9-a7ac-d046ffefabaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:23 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Flow 'volume_create_manager' (fe6232c4-9725-405d-83ec-99204a76a488) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:23 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-9c4727cc-cdad-4a67-9336-e1356a70d4fa tempest-CreateVolumesFromSnapshotTest-2041147618 None] Created volume successfully. Sep 29 18:58:24 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a 1073741824" returned: 0 in 0.589s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:24 devstack sudo[108037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a Sep 29 18:58:24 devstack sudo[108037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:24 devstack sudo[108037]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a" returned: 0 in 0.278s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.682s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-904862489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50c2aba6-2223-4869-8b5d-9e093462220f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f66bf409aa4cffaee6b5c2e7978d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:23Z,use_quota=True,user_id='4eae27e656fd4b418124f21aa8f6be74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Creating volume 50c2aba6-2223-4869-8b5d-9e093462220f {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:24 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-50c2aba6-2223-4869-8b5d-9e093462220f 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:24 devstack sudo[108040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-50c2aba6-2223-4869-8b5d-9e093462220f 1073741824 Sep 29 18:58:24 devstack sudo[108040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d66dc546-6749-4beb-8c62-8e821a029e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd5c806-c520-46b7-9d40-0eb066d91ab4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:24 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Volume volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a (d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a): created successfully Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfd5c806-c520-46b7-9d40-0eb066d91ab4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:24 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Flow 'volume_create_manager' (fa4f9ada-26d2-4437-9a5c-4934fe71fb9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:24 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f45575c0-7bd5-469c-a991-3ebbcced6023 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Created volume successfully. Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-quobyte-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a" acquired by "delete_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad89d23-aa3d-4400-a5b1-491da980b5e9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:25 devstack sudo[108040]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-50c2aba6-2223-4869-8b5d-9e093462220f 1073741824" returned: 0 in 0.719s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-50c2aba6-2223-4869-8b5d-9e093462220f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:25 devstack sudo[108045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a Sep 29 18:58:25 devstack sudo[108045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:25 devstack sudo[108046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-50c2aba6-2223-4869-8b5d-9e093462220f Sep 29 18:58:25 devstack sudo[108046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:25 devstack sudo[108046]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-50c2aba6-2223-4869-8b5d-9e093462220f" returned: 0 in 0.337s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] <== create_volume: return (1126ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:25 devstack sudo[108045]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a" returned: 0 in 0.453s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:25 devstack sudo[108053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a Sep 29 18:58:25 devstack sudo[108053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d683fb-8edc-48e8-80af-43d70fcf6ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50c2aba6-2223-4869-8b5d-9e093462220f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11cbf67-1a06-4b50-b17e-109167067b57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:25 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Volume volume-50c2aba6-2223-4869-8b5d-9e093462220f (50c2aba6-2223-4869-8b5d-9e093462220f): created successfully Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b11cbf67-1a06-4b50-b17e-109167067b57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:25 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Flow 'volume_create_manager' (ec684480-93ca-428b-8302-fcba52ec6280) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:25 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7c277c07-db6c-45b6-b882-8d468aaf278b tempest-ProjectReaderTests-1837953543 None] Created volume successfully. Sep 29 18:58:26 devstack sudo[108053]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a" returned: 0 in 0.320s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Acquiring lock "cinder-50c2aba6-2223-4869-8b5d-9e093462220f-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a" released by "delete_volume" :: held 0.835s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Lock "cinder-50c2aba6-2223-4869-8b5d-9e093462220f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Acquiring lock "cinder-quobyte-50c2aba6-2223-4869-8b5d-9e093462220f" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Lock "cinder-quobyte-50c2aba6-2223-4869-8b5d-9e093462220f" acquired by "delete_volume" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Created reservations ['24b7007d-06c2-4082-b23d-8919186de2d2', '61ca3809-7cf9-4c21-9b4f-980bf6e70a53', 'ccf3e3ab-2914-48e6-a109-9aff0167b82e', '9644b8fd-da16-4f35-809d-21d074c472a2'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a236c1e9-252d-4bcd-bb3b-bd927543386c]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-50c2aba6-2223-4869-8b5d-9e093462220f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:26 devstack sudo[108056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-50c2aba6-2223-4869-8b5d-9e093462220f Sep 29 18:58:26 devstack sudo[108056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:26 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:26 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-c65b48f7-352a-4202-afe5-f16c04123cdd-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-c65b48f7-352a-4202-afe5-f16c04123cdd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-quobyte-c65b48f7-352a-4202-afe5-f16c04123cdd" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-c65b48f7-352a-4202-afe5-f16c04123cdd" acquired by "delete_volume" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae8521b-fe94-4268-8b26-8decd81e1bc0]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c65b48f7-352a-4202-afe5-f16c04123cdd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:26 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c65b48f7-352a-4202-afe5-f16c04123cdd Sep 29 18:58:26 devstack sudo[108056]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:26 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-50c2aba6-2223-4869-8b5d-9e093462220f" returned: 0 in 0.557s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-50c2aba6-2223-4869-8b5d-9e093462220f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:26 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-50c2aba6-2223-4869-8b5d-9e093462220f Sep 29 18:58:26 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:26 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.512s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:26 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Deleted volume successfully. Sep 29 18:58:26 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1a7d7120-fb0e-44f2-b0f7-0731be2255d0 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-d89a4ef4-b5ae-4fbf-aa1a-6270e127d29a-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:27 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c65b48f7-352a-4202-afe5-f16c04123cdd" returned: 0 in 0.449s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c65b48f7-352a-4202-afe5-f16c04123cdd {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:27 devstack sudo[108072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c65b48f7-352a-4202-afe5-f16c04123cdd Sep 29 18:58:27 devstack sudo[108072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:27 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-50c2aba6-2223-4869-8b5d-9e093462220f" returned: 0 in 0.384s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Lock "cinder-quobyte-50c2aba6-2223-4869-8b5d-9e093462220f" released by "delete_volume" :: held 1.016s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Created reservations ['721d7e2f-f944-4cbe-8116-f6bd0c69c90a', 'b32b14bf-31ec-4939-843d-f67fc97c5077', '01fd71a6-7ffa-49b7-9d83-5be763e8198b', '4dc49dbe-7c8a-4a2d-b932-e9f2ef0f00cd'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:27 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:27 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:27 devstack sudo[108072]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-c65b48f7-352a-4202-afe5-f16c04123cdd" returned: 0 in 0.369s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-c65b48f7-352a-4202-afe5-f16c04123cdd" released by "delete_volume" :: held 0.904s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Created reservations ['a74caed1-d030-46d1-8c74-5dc590738efe', 'ce1bd5a2-bdd4-4c84-b71b-52749bd233c9', '0d1557b4-e849-46cf-85d3-b1b510b9a78b', '00891fa2-38c9-4d17-ae86-ebf0c8f6939c'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:27 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:27 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-510c547a-8fa9-4e11-849c-70644cab8078-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:27 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.439s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Deleted volume successfully. Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-510c547a-8fa9-4e11-849c-70644cab8078-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8f7c3612-ad67-4325-a82a-c1b9ab33f5aa tempest-ProjectReaderTests-1837953543 None] Lock "cinder-50c2aba6-2223-4869-8b5d-9e093462220f-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-quobyte-510c547a-8fa9-4e11-849c-70644cab8078" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-510c547a-8fa9-4e11-849c-70644cab8078" acquired by "delete_volume" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:28 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff8553e-99c7-4f20-afa3-25a835ece31e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-510c547a-8fa9-4e11-849c-70644cab8078 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:28 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.415s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:28 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:28 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Deleted volume successfully. Sep 29 18:58:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-388e5c03-c15e-4a66-a575-e3d252adeb9a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-c65b48f7-352a-4202-afe5-f16c04123cdd-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:28 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-510c547a-8fa9-4e11-849c-70644cab8078 Sep 29 18:58:28 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:28 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-510c547a-8fa9-4e11-849c-70644cab8078" returned: 0 in 0.468s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-510c547a-8fa9-4e11-849c-70644cab8078 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:28 devstack sudo[108087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-510c547a-8fa9-4e11-849c-70644cab8078 Sep 29 18:58:28 devstack sudo[108087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:28 devstack sudo[108087]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-510c547a-8fa9-4e11-849c-70644cab8078" returned: 0 in 0.370s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-510c547a-8fa9-4e11-849c-70644cab8078" released by "delete_volume" :: held 0.896s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Created reservations ['a4c40986-ac83-4274-b2d3-de31962e7dcf', 'fdea06dd-4b67-4c4a-bae5-9b1a49faf76e', 'dcdb5cf2-15f9-47b5-9a06-5f5262828676', '85be6c47-ef60-4b50-8a49-8293cbf2bce1'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Flow 'volume_create_manager' (0514e2e8-b5c4-490f-a13b-60e2a55d3a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:29 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:29 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04682297-9f3d-43fa-9dc8-11d660d19b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04682297-9f3d-43fa-9dc8-11d660d19b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430634661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da4c028-ed3f-4705-8d55-05b1c6e6a858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f66bf409aa4cffaee6b5c2e7978d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:29Z,use_quota=True,user_id='4eae27e656fd4b418124f21aa8f6be74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87c23fa-f671-4649-80c1-dea186bec120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87c23fa-f671-4649-80c1-dea186bec120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808b5f14-e6fd-4ea9-9639-ce1fb26f4e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808b5f14-e6fd-4ea9-9639-ce1fb26f4e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6da4c028-ed3f-4705-8d55-05b1c6e6a858', 'volume_name': 'volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e8867a-182c-436a-b2b6-c9555cee6c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5e8867a-182c-436a-b2b6-c9555cee6c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0620b5a5-9afd-4990-bc41-349c435386d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:29 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Volume 6da4c028-ed3f-4705-8d55-05b1c6e6a858: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858', 'volume_size': 1} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-430634661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6da4c028-ed3f-4705-8d55-05b1c6e6a858,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f66bf409aa4cffaee6b5c2e7978d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:29Z,use_quota=True,user_id='4eae27e656fd4b418124f21aa8f6be74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Creating volume 6da4c028-ed3f-4705-8d55-05b1c6e6a858 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:29 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-445288a6-d93d-40a2-9765-70102e03717e-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-445288a6-d93d-40a2-9765-70102e03717e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:29 devstack sudo[108092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858 1073741824 Sep 29 18:58:29 devstack sudo[108092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-quobyte-445288a6-d93d-40a2-9765-70102e03717e" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-445288a6-d93d-40a2-9765-70102e03717e" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[493da285-4bdc-4727-a515-21bbdb662118]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-445288a6-d93d-40a2-9765-70102e03717e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:29 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.406s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:29 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Deleted volume successfully. Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b85ab10c-2581-4e7d-8e62-d521aea393fd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-510c547a-8fa9-4e11-849c-70644cab8078-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:29 devstack sudo[108094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-445288a6-d93d-40a2-9765-70102e03717e Sep 29 18:58:29 devstack sudo[108094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:29 devstack sudo[108094]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-445288a6-d93d-40a2-9765-70102e03717e" returned: 0 in 0.425s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-445288a6-d93d-40a2-9765-70102e03717e {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:29 devstack sudo[108092]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858 1073741824" returned: 0 in 0.608s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:29 devstack sudo[108104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-445288a6-d93d-40a2-9765-70102e03717e Sep 29 18:58:29 devstack sudo[108104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:30 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858 Sep 29 18:58:30 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:30 devstack sudo[108104]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-445288a6-d93d-40a2-9765-70102e03717e" returned: 0 in 0.279s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-445288a6-d93d-40a2-9765-70102e03717e" released by "delete_volume" :: held 0.754s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:30 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858" returned: 0 in 0.253s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0620b5a5-9afd-4990-bc41-349c435386d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd67528-8693-4f6b-a191-19d82418719d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:30 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Volume volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858 (6da4c028-ed3f-4705-8d55-05b1c6e6a858): created successfully Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bd67528-8693-4f6b-a191-19d82418719d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Flow 'volume_create_manager' (0514e2e8-b5c4-490f-a13b-60e2a55d3a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Created reservations ['d6170498-11d0-417b-9a2d-2acfdf4bd09f', '484145f8-38a0-4f88-acd7-693dfd235627', '2b5c7d51-2c56-46ba-a312-276d3e60cde4', '6f5ecceb-75a1-4316-8718-a7c9df0aa54d'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-102d0f7d-ab47-4e32-a243-48409508ebd2 tempest-ProjectReaderTests-1837953543 None] Created volume successfully. Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:30 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:30 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-42b2971e-a30b-43ad-a072-01289c286c50-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-42b2971e-a30b-43ad-a072-01289c286c50-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-quobyte-42b2971e-a30b-43ad-a072-01289c286c50" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-42b2971e-a30b-43ad-a072-01289c286c50" acquired by "delete_volume" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[800f35e8-243b-4130-b2e0-8bce7314bd4e]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-42b2971e-a30b-43ad-a072-01289c286c50 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:30 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.336s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Deleted volume successfully. Sep 29 18:58:30 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5a89669a-a2fe-469c-b140-6bf76f15d1dd tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-445288a6-d93d-40a2-9765-70102e03717e-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:30 devstack sudo[108112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-42b2971e-a30b-43ad-a072-01289c286c50 Sep 29 18:58:30 devstack sudo[108112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:31 devstack sudo[108112]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-42b2971e-a30b-43ad-a072-01289c286c50" returned: 0 in 0.429s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-42b2971e-a30b-43ad-a072-01289c286c50 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:31 devstack sudo[108121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-42b2971e-a30b-43ad-a072-01289c286c50 Sep 29 18:58:31 devstack sudo[108121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Acquiring lock "cinder-6da4c028-ed3f-4705-8d55-05b1c6e6a858-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Lock "cinder-6da4c028-ed3f-4705-8d55-05b1c6e6a858-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Acquiring lock "cinder-quobyte-6da4c028-ed3f-4705-8d55-05b1c6e6a858" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Lock "cinder-quobyte-6da4c028-ed3f-4705-8d55-05b1c6e6a858" acquired by "delete_volume" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:31 devstack sudo[108121]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-42b2971e-a30b-43ad-a072-01289c286c50" returned: 0 in 0.367s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-42b2971e-a30b-43ad-a072-01289c286c50" released by "delete_volume" :: held 0.859s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[926054b9-ffec-49a8-a421-8b5561cbf295]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Created reservations ['53682de0-559e-4943-ab61-211bc30d2ed9', 'cb305ade-9f9f-4278-9a1b-aa57ee01ded0', '0f5eab6f-8863-4008-8a04-06a1743731d4', '26ec183b-e612-4888-bb26-f26663442eb0'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:31 devstack sudo[108124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858 Sep 29 18:58:31 devstack sudo[108124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (3bf0b651-1256-49d8-9f82-386d777cb9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8026fc20-6e52-42cc-80a4-e07624098a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8026fc20-6e52-42cc-80a4-e07624098a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-504314493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3354534f-2746-4af7-a6cb-4eee9dc9a4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:32Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e221ab-3954-4c6f-b4ed-f5855c166dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6e221ab-3954-4c6f-b4ed-f5855c166dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36ded9b-02d8-4d11-a6f5-ace47ec063e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e36ded9b-02d8-4d11-a6f5-ace47ec063e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3354534f-2746-4af7-a6cb-4eee9dc9a4fc', 'volume_name': 'volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc74ee4-ab27-42a5-b93a-605ba8074d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc74ee4-ab27-42a5-b93a-605ba8074d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39505d6-05ca-443b-9da6-3561f0f8360c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:31 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Volume 3354534f-2746-4af7-a6cb-4eee9dc9a4fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc', 'volume_size': 1} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-504314493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3354534f-2746-4af7-a6cb-4eee9dc9a4fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:32Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Creating volume 3354534f-2746-4af7-a6cb-4eee9dc9a4fc {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:31 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:31 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc 1073741824 Sep 29 18:58:31 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-ac5431d1-335a-40cb-80be-e8f51b298b00-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-ac5431d1-335a-40cb-80be-e8f51b298b00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-quobyte-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:31 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:31 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-quobyte-ac5431d1-335a-40cb-80be-e8f51b298b00" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-ac5431d1-335a-40cb-80be-e8f51b298b00" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Deleting offline snapshot ac5431d1-335a-40cb-80be-e8f51b298b00 of volume bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:58:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] snapshot_file for this snap is: volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8e0916-f891-41f8-bd69-fffb01c3f018]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:32 devstack sudo[108124]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858" returned: 0 in 0.531s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:32 devstack sudo[108134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858 Sep 29 18:58:32 devstack sudo[108134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:32 devstack sudo[108133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 Sep 29 18:58:32 devstack sudo[108133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:32 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.409s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:32 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Deleted volume successfully. Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-807d64e0-6282-465f-99f1-ea99e8c278f9 tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-42b2971e-a30b-43ad-a072-01289c286c50-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:32 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc 1073741824" returned: 0 in 0.613s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:32 devstack sudo[108134]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-6da4c028-ed3f-4705-8d55-05b1c6e6a858" returned: 0 in 0.383s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Lock "cinder-quobyte-6da4c028-ed3f-4705-8d55-05b1c6e6a858" released by "delete_volume" :: held 1.004s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:32 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc Sep 29 18:58:32 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Created reservations ['26dc2fdb-edbf-450d-b4b9-d9d77fad1c47', 'c5f01313-3921-4b1f-ae5d-4a06333f158b', 'd7b255b2-9d39-40f3-85bc-e891d52f365e', 'ff7e71d9-7cee-42df-a23c-2af5a0fe822d'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:32 devstack sudo[108133]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00" returned: 0 in 0.516s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[702c5f4b-d2ac-4633-a36b-c3944bbc4ba3]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:32 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:32 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:32 devstack sudo[108148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 Sep 29 18:58:32 devstack sudo[108148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:32 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc" returned: 0 in 0.314s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39505d6-05ca-443b-9da6-3561f0f8360c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6268d8e7-ae26-4d9a-9ab7-1aaa5b646a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:32 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Volume volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc (3354534f-2746-4af7-a6cb-4eee9dc9a4fc): created successfully Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6268d8e7-ae26-4d9a-9ab7-1aaa5b646a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (3bf0b651-1256-49d8-9f82-386d777cb9f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:32 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3a951a7b-3110-4bf3-a411-b1a5f357a0da tempest-ProjectMemberTests-1585924540 None] Created volume successfully. Sep 29 18:58:32 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.278s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:32 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Deleted volume successfully. Sep 29 18:58:32 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5fef3380-c648-4a85-a7a1-2b91a03d7d92 tempest-ProjectReaderTests-1837953543 None] Lock "cinder-6da4c028-ed3f-4705-8d55-05b1c6e6a858-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:33 devstack sudo[108148]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35" returned: 0 in 0.439s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:33 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 Sep 29 18:58:33 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:33 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00" returned: 0 in 0.386s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:33 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00 Sep 29 18:58:33 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:33 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35.ac5431d1-335a-40cb-80be-e8f51b298b00" returned: 0 in 0.308s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-ac5431d1-335a-40cb-80be-e8f51b298b00" released by "_delete_snapshot" :: held 1.826s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35" released by "delete_snapshot" :: held 1.868s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:33 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Created reservations ['5752c364-fcb1-433e-973b-aac90fa3eb97', '47c29212-b9df-4be0-993d-4db3c9e6ad32', '57abb3eb-21bf-4867-8205-058caea78da6', '9278148d-ea1e-4f17-946d-f37938154a78'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:33 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Delete snapshot completed successfully. Sep 29 18:58:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-8af1f092-fe3a-4dde-9154-e79efba1e28a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-ac5431d1-335a-40cb-80be-e8f51b298b00-delete_snapshot" released by "delete_snapshot" :: held 2.097s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "cinder-quobyte-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Flow 'volume_create_manager' (1ab8653f-f3e0-4271-83cb-43bd681cb8a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fef975-7105-4640-bfbf-8f472f1a1f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31fef975-7105-4640-bfbf-8f472f1a1f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-634302703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9857af-8526-42f6-8b5d-d8121264c1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f66bf409aa4cffaee6b5c2e7978d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:34Z,use_quota=True,user_id='4eae27e656fd4b418124f21aa8f6be74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778e3462-9cb5-43b9-80af-bb74ae0e7a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (778e3462-9cb5-43b9-80af-bb74ae0e7a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf9efde-b0ba-416a-afb5-ab868f43fe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf9efde-b0ba-416a-afb5-ab868f43fe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c9857af-8526-42f6-8b5d-d8121264c1bb', 'volume_name': 'volume-0c9857af-8526-42f6-8b5d-d8121264c1bb', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ce90b1-2796-4a5f-8157-3ef9cc4ddfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4ce90b1-2796-4a5f-8157-3ef9cc4ddfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93afc888-f54b-4218-a449-b48d94384d10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:34 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Volume 0c9857af-8526-42f6-8b5d-d8121264c1bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c9857af-8526-42f6-8b5d-d8121264c1bb', 'volume_size': 1} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-634302703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c9857af-8526-42f6-8b5d-d8121264c1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68f66bf409aa4cffaee6b5c2e7978d71',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:34Z,use_quota=True,user_id='4eae27e656fd4b418124f21aa8f6be74',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Creating volume 0c9857af-8526-42f6-8b5d-d8121264c1bb {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:34 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0c9857af-8526-42f6-8b5d-d8121264c1bb 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35" acquired by "delete_volume" :: waited 0.141s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:34 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0c9857af-8526-42f6-8b5d-d8121264c1bb 1073741824 Sep 29 18:58:34 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ecf1f5-8caa-465b-a6a5-b965bcf79360]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:34 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 Sep 29 18:58:34 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:34 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:34 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0c9857af-8526-42f6-8b5d-d8121264c1bb 1073741824" returned: 0 in 0.533s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35" returned: 0 in 0.436s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:34 devstack sudo[108180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35 Sep 29 18:58:34 devstack sudo[108180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0c9857af-8526-42f6-8b5d-d8121264c1bb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:35 devstack sudo[108183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0c9857af-8526-42f6-8b5d-d8121264c1bb Sep 29 18:58:35 devstack sudo[108183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:35 devstack sudo[108180]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35" returned: 0 in 0.313s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-quobyte-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35" released by "delete_volume" :: held 0.869s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:35 devstack sudo[108183]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0c9857af-8526-42f6-8b5d-d8121264c1bb" returned: 0 in 0.327s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.785s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93afc888-f54b-4218-a449-b48d94384d10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c9857af-8526-42f6-8b5d-d8121264c1bb', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebed157-752f-437f-91ff-79ceb02fa80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] Creating offline snapshot 866d8f45-2e42-4625-8e3e-9edb2fe4aab1 of volume 3354534f-2746-4af7-a6cb-4eee9dc9a4fc {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:58:35 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Volume volume-0c9857af-8526-42f6-8b5d-d8121264c1bb (0c9857af-8526-42f6-8b5d-d8121264c1bb): created successfully Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ebed157-752f-437f-91ff-79ceb02fa80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Flow 'volume_create_manager' (1ab8653f-f3e0-4271-83cb-43bd681cb8a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e80340-02e6-41ec-83d3-51c579d74b48]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:35 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d1c5dc14-9798-4e43-8acb-c701d4f75307 tempest-ProjectReaderTests-1837953543 None] Created volume successfully. Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Created reservations ['6576dba5-bea6-4d11-915a-cb6ed40ddd3f', '48a3b040-e604-4b4f-965a-a4e5c32bd7aa', '0be67442-5ffc-4d97-9bf1-ae393a1e7657', '3f4c041f-18f1-49e7-823c-4ffcf77f01ee'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:35 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc Sep 29 18:58:35 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:35 devstack sudo[108188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:35 devstack sudo[108188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:35 devstack sudo[108188]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.270s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:35 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Deleted volume successfully. Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-5941ac94-2948-4749-89d9-0cde3f06f86a tempest-CreateVolumesFromSnapshotTest-2041147618 None] Lock "cinder-bd6edb16-e44c-4ff3-8df7-2569c2b5ef35-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:35 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc" returned: 0 in 0.463s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:35 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 1G Sep 29 18:58:35 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Acquiring lock "cinder-0c9857af-8526-42f6-8b5d-d8121264c1bb-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Lock "cinder-0c9857af-8526-42f6-8b5d-d8121264c1bb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:36 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 1G" returned: 0 in 0.553s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Acquiring lock "cinder-quobyte-0c9857af-8526-42f6-8b5d-d8121264c1bb" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:36 devstack sudo[108201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 Sep 29 18:58:36 devstack sudo[108201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:36 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Lock "cinder-quobyte-0c9857af-8526-42f6-8b5d-d8121264c1bb" acquired by "delete_volume" :: waited 0.034s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:36 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0492ef-9d0d-4675-bede-bf0a41c34059]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0c9857af-8526-42f6-8b5d-d8121264c1bb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:36 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0c9857af-8526-42f6-8b5d-d8121264c1bb Sep 29 18:58:36 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:36 devstack sudo[108201]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1" returned: 0 in 0.380s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:36 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 is being set with open permissions: ugo+rw Sep 29 18:58:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:36 devstack sudo[108209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 Sep 29 18:58:36 devstack sudo[108209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:36 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0c9857af-8526-42f6-8b5d-d8121264c1bb" returned: 0 in 0.479s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0c9857af-8526-42f6-8b5d-d8121264c1bb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:37 devstack sudo[108214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0c9857af-8526-42f6-8b5d-d8121264c1bb Sep 29 18:58:37 devstack sudo[108214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:37 devstack sudo[108209]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1" returned: 0 in 0.313s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:37 devstack sudo[108217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.info Sep 29 18:58:37 devstack sudo[108217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:37 devstack sudo[108214]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-0c9857af-8526-42f6-8b5d-d8121264c1bb" returned: 0 in 0.343s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Lock "cinder-quobyte-0c9857af-8526-42f6-8b5d-d8121264c1bb" released by "delete_volume" :: held 0.907s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Created reservations ['1600078d-9021-4ce2-8682-91ce2e514ab5', 'dab545b1-34a7-4c5b-aed8-7425ace89318', 'c9638aae-85f3-4e54-964e-c1978c4a1104', 'aff847ab-6383-4802-9186-b61121969bc7'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=269,cinder:SELECT=185,cinder:INSERT=77,cinder:DELETE=23 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:58:37 devstack sudo[108217]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.info" returned: 0 in 0.427s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:37 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.info is being set with open permissions: ugo+rw Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:37 devstack sudo[108221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:37 devstack sudo[108221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:37 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.info Sep 29 18:58:37 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:37 devstack sudo[108221]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.353s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:37 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Deleted volume successfully. Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-7fb4eadd-5c33-4acc-8aec-258c997a689b tempest-ProjectReaderTests-1837953543 None] Lock "cinder-0c9857af-8526-42f6-8b5d-d8121264c1bb-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:37 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.info" returned: 0 in 0.385s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.719s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:38 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=200,cinder:UPDATE=249,cinder:INSERT=64,cinder:DELETE=22 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:58:38 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ad4218bc-3f83-481f-b5a2-cd077e3b39c1 tempest-ProjectMemberTests-1585924540 None] Create snapshot completed successfully Sep 29 18:58:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-866d8f45-2e42-4625-8e3e-9edb2fe4aab1-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Lock "cinder-866d8f45-2e42-4625-8e3e-9edb2fe4aab1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-3354534f-2746-4af7-a6cb-4eee9dc9a4fc" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-3354534f-2746-4af7-a6cb-4eee9dc9a4fc" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-866d8f45-2e42-4625-8e3e-9edb2fe4aab1" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-866d8f45-2e42-4625-8e3e-9edb2fe4aab1" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Deleting offline snapshot 866d8f45-2e42-4625-8e3e-9edb2fe4aab1 of volume 3354534f-2746-4af7-a6cb-4eee9dc9a4fc {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:58:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] snapshot_file for this snap is: volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:58:38 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cf1920-7ca0-4e0f-bee4-3f12f065ffe6]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:39 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 Sep 29 18:58:39 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:39 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1" returned: 0 in 0.512s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:58:39 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e3c5c40-6a9a-465f-ad77-f4ca73fa2473]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:39 devstack sudo[108232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc Sep 29 18:58:39 devstack sudo[108232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:39 devstack sudo[108232]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc" returned: 0 in 0.463s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:39 devstack sudo[108237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 Sep 29 18:58:39 devstack sudo[108237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:40 devstack sudo[108237]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1" returned: 0 in 0.460s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:40 devstack sudo[108242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1 Sep 29 18:58:40 devstack sudo[108242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:40 devstack sudo[108242]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc.866d8f45-2e42-4625-8e3e-9edb2fe4aab1" returned: 0 in 0.347s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-866d8f45-2e42-4625-8e3e-9edb2fe4aab1" released by "_delete_snapshot" :: held 1.977s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Flow 'volume_create_manager' (8029d27a-21ff-4dc5-b985-6b6b223f2742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e9d7a9-ae9d-4f35-b9c3-55427137deb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-3354534f-2746-4af7-a6cb-4eee9dc9a4fc" released by "delete_snapshot" :: held 2.067s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18e9d7a9-ae9d-4f35-b9c3-55427137deb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-867096178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ba3429-07c9-4f05-96ac-33d469ca53c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984c990c309459fb9755cc0ffa04db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:41Z,use_quota=True,user_id='6055ac0d851e4cecb44acef9e5f0f91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6783628-8c0c-400b-a967-ec70d917c582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6783628-8c0c-400b-a967-ec70d917c582) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58825c79-3542-42b6-8ad6-f64be95da32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58825c79-3542-42b6-8ad6-f64be95da32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4ba3429-07c9-4f05-96ac-33d469ca53c7', 'volume_name': 'volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b69d76d-90c0-40c8-a602-a0efbd391465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b69d76d-90c0-40c8-a602-a0efbd391465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1c09b1-fae9-448a-bb26-6f943c62ada1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:40 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume b4ba3429-07c9-4f05-96ac-33d469ca53c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7', 'volume_size': 1} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-867096178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4ba3429-07c9-4f05-96ac-33d469ca53c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984c990c309459fb9755cc0ffa04db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:41Z,use_quota=True,user_id='6055ac0d851e4cecb44acef9e5f0f91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Creating volume b4ba3429-07c9-4f05-96ac-33d469ca53c7 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:40 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:40 devstack sudo[108245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7 1073741824 Sep 29 18:58:40 devstack sudo[108245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:41 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Created reservations ['e3023f7f-395a-4243-999a-f65193505f8b', 'a1cc5cf1-4910-4b2a-9cf7-72ee3fe69a90', '347b4983-64d9-443a-8944-1c481a0f87dc', '91255832-f5ee-42bd-8e8e-9dbee2d2440e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:41 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Delete snapshot completed successfully. Sep 29 18:58:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1f3d369b-9c34-4956-abed-a0bc92f9603f tempest-ProjectMemberTests-1585924540 None] Lock "cinder-866d8f45-2e42-4625-8e3e-9edb2fe4aab1-delete_snapshot" released by "delete_snapshot" :: held 2.354s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:41 devstack sudo[108245]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7 1073741824" returned: 0 in 0.560s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:41 devstack sudo[108251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7 Sep 29 18:58:41 devstack sudo[108251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:41 devstack sudo[108251]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7" returned: 0 in 0.266s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c1c09b1-fae9-448a-bb26-6f943c62ada1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999f4c15-422f-48a3-bcfe-148fbba179af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:41 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7 (b4ba3429-07c9-4f05-96ac-33d469ca53c7): created successfully Sep 29 18:58:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (999f4c15-422f-48a3-bcfe-148fbba179af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:41 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Flow 'volume_create_manager' (8029d27a-21ff-4dc5-b985-6b6b223f2742) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:41 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2005677b-2bb4-4bb2-9f2d-9819b33451a9 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Created volume successfully. Sep 29 18:58:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-3354534f-2746-4af7-a6cb-4eee9dc9a4fc-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Lock "cinder-3354534f-2746-4af7-a6cb-4eee9dc9a4fc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-3354534f-2746-4af7-a6cb-4eee9dc9a4fc" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-3354534f-2746-4af7-a6cb-4eee9dc9a4fc" acquired by "delete_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:42 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[65244a87-1b55-4f01-9961-6c20b49d9e65]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:42 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc Sep 29 18:58:42 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:42 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc" returned: 0 in 0.387s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:42 devstack sudo[108259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc Sep 29 18:58:42 devstack sudo[108259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:42 devstack sudo[108259]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3354534f-2746-4af7-a6cb-4eee9dc9a4fc" returned: 0 in 0.276s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-3354534f-2746-4af7-a6cb-4eee9dc9a4fc" released by "delete_volume" :: held 0.736s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:42 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Created reservations ['a009b9c6-c95c-460d-83da-3d7eb8e5fac8', '161a6b16-8fc6-4c68-a04e-118b8946529c', 'ec4a398d-5068-48dd-ba8d-702980a5f04e', '52c87bc2-559f-4fc7-9a43-6228408cb9c5'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:43 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:43 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:43 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.422s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:43 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Deleted volume successfully. Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1ca2e935-8566-4d25-9a53-a6d78ca597dc tempest-ProjectMemberTests-1585924540 None] Lock "cinder-3354534f-2746-4af7-a6cb-4eee9dc9a4fc-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Flow 'volume_create_manager' (d83af1ca-e138-4b8c-a965-57de386f3772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68371727-fe05-4ce6-a323-2a5fd6acf21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68371727-fe05-4ce6-a323-2a5fd6acf21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-998825795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191ee60a-d57d-43ee-bcb7-749f6a284dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984c990c309459fb9755cc0ffa04db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:44Z,use_quota=True,user_id='6055ac0d851e4cecb44acef9e5f0f91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa16215e-fed8-42ba-ae1b-5fe6f326171f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa16215e-fed8-42ba-ae1b-5fe6f326171f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6ec0a4-8a9f-41e1-becd-fe48368d50dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd6ec0a4-8a9f-41e1-becd-fe48368d50dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '191ee60a-d57d-43ee-bcb7-749f6a284dc7', 'volume_name': 'volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270d213d-8b53-40c9-9e60-feba8f9ba7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (270d213d-8b53-40c9-9e60-feba8f9ba7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae6d430-f0be-4bc1-bb57-c83e47f3ea12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:43 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume 191ee60a-d57d-43ee-bcb7-749f6a284dc7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7', 'volume_size': 1} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-998825795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=191ee60a-d57d-43ee-bcb7-749f6a284dc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984c990c309459fb9755cc0ffa04db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:44Z,use_quota=True,user_id='6055ac0d851e4cecb44acef9e5f0f91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Creating volume 191ee60a-d57d-43ee-bcb7-749f6a284dc7 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:43 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:43 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7 1073741824 Sep 29 18:58:43 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (d41074e7-ef7e-4f91-9d61-45032c8156f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba579dc0-b0f4-4237-ad94-ab8a592f4f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba579dc0-b0f4-4237-ad94-ab8a592f4f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355703136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7367f341-d4df-42fd-b641-a60977436fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:44Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3dfbe7-2ffc-4e21-8086-21286a7312e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:43 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff3dfbe7-2ffc-4e21-8086-21286a7312e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1e6bf3-cf25-41a5-8686-5334d2257966) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de1e6bf3-cf25-41a5-8686-5334d2257966) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7367f341-d4df-42fd-b641-a60977436fa1', 'volume_name': 'volume-7367f341-d4df-42fd-b641-a60977436fa1', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59ba9ff-332e-4cc1-b779-91beef86535f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f59ba9ff-332e-4cc1-b779-91beef86535f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c792138-e822-4004-8c3e-0144003efa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Volume 7367f341-d4df-42fd-b641-a60977436fa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7367f341-d4df-42fd-b641-a60977436fa1', 'volume_size': 1} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Flow 'volume_create_manager' (e4da7500-3f20-45e8-b1a4-72f1e42eacf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896314ba-f1d5-4bd0-84ef-8cdf58af0d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (896314ba-f1d5-4bd0-84ef-8cdf58af0d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1956749729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fe44a4-9951-490b-a9fe-df3b946e3d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984c990c309459fb9755cc0ffa04db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:44Z,use_quota=True,user_id='6055ac0d851e4cecb44acef9e5f0f91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0470fa-4fc4-4e27-ab37-ef1305248b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd0470fa-4fc4-4e27-ab37-ef1305248b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9642f5-94ea-4dba-8484-12aeab2fb4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a9642f5-94ea-4dba-8484-12aeab2fb4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57fe44a4-9951-490b-a9fe-df3b946e3d4f', 'volume_name': 'volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e45cb8-c26e-4adb-9b93-e66aab09d70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1e45cb8-c26e-4adb-9b93-e66aab09d70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19dbaf60-65dd-4e81-9eb7-e285f74e0b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume 57fe44a4-9951-490b-a9fe-df3b946e3d4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f', 'volume_size': 1} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:44 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7 1073741824" returned: 0 in 0.694s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:44 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7 Sep 29 18:58:44 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Flow 'volume_create_manager' (ef0c482d-0f99-4d4b-a0f1-35e3cc3e6c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f931bc-a6fb-4f89-91b6-e2c72678a50c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81f931bc-a6fb-4f89-91b6-e2c72678a50c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-732305282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaea2a1-22d9-45c2-9359-b7d9e35603f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984c990c309459fb9755cc0ffa04db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:45Z,use_quota=True,user_id='6055ac0d851e4cecb44acef9e5f0f91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962de73b-40d9-4f1d-9900-3b4f9d083d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (962de73b-40d9-4f1d-9900-3b4f9d083d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9154b31f-a51a-4ff9-b405-f2ff61237495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9154b31f-a51a-4ff9-b405-f2ff61237495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acaea2a1-22d9-45c2-9359-b7d9e35603f5', 'volume_name': 'volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a225275f-0646-4566-aec3-94ac019087ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a225275f-0646-4566-aec3-94ac019087ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db03f75-0ba9-4220-9af7-354d41d06073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume acaea2a1-22d9-45c2-9359-b7d9e35603f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5', 'volume_size': 1} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:44 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7" returned: 0 in 0.315s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.834s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1355703136',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7367f341-d4df-42fd-b641-a60977436fa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:44Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Creating volume 7367f341-d4df-42fd-b641-a60977436fa1 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:44 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bae6d430-f0be-4bc1-bb57-c83e47f3ea12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3caa56ec-bc9b-4611-9dee-8bc353d5c458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:44 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1 1073741824 Sep 29 18:58:44 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:44 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7 (191ee60a-d57d-43ee-bcb7-749f6a284dc7): created successfully Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3caa56ec-bc9b-4611-9dee-8bc353d5c458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Flow 'volume_create_manager' (d83af1ca-e138-4b8c-a965-57de386f3772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:44 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-fcfbff9a-00b6-4ce0-9b64-02a3891c8423 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Created volume successfully. Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Flow 'volume_create_manager' (591b114f-54ac-4ec7-a318-7ea0d07e49d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28c6f72-2d52-4428-8fb9-cf2abd50dbf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b28c6f72-2d52-4428-8fb9-cf2abd50dbf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-62910376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8dabe14-e0a8-4f10-921d-33fa3a626cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984c990c309459fb9755cc0ffa04db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:45Z,use_quota=True,user_id='6055ac0d851e4cecb44acef9e5f0f91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93af2b9-365f-4782-8011-4ffcac86de1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c93af2b9-365f-4782-8011-4ffcac86de1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b72ec22-55b3-4fdc-a93f-9a15a6aac256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b72ec22-55b3-4fdc-a93f-9a15a6aac256) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8dabe14-e0a8-4f10-921d-33fa3a626cd1', 'volume_name': 'volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2967dfb-72b3-4ea5-9ba6-3af2bb0e8094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2967dfb-72b3-4ea5-9ba6-3af2bb0e8094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c4b3e9-646f-4fe5-a8e5-77b9eda4b285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:45 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume a8dabe14-e0a8-4f10-921d-33fa3a626cd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1', 'volume_size': 1} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:45 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1 1073741824" returned: 0 in 0.662s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:45 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1 Sep 29 18:58:45 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Flow 'volume_create_manager' (21e8e393-900d-44a5-b524-70023e2cbaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88014e5c-b0cf-4c0e-b3ca-59011b5b9254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88014e5c-b0cf-4c0e-b3ca-59011b5b9254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556832781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cb6981-ff86-4031-83f5-8031782525cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984c990c309459fb9755cc0ffa04db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:46Z,use_quota=True,user_id='6055ac0d851e4cecb44acef9e5f0f91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584f860d-cb79-4693-a21a-6e8bd31c5fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (584f860d-cb79-4693-a21a-6e8bd31c5fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0006b7d0-8563-4081-b0ab-4b18d66d61f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0006b7d0-8563-4081-b0ab-4b18d66d61f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6cb6981-ff86-4031-83f5-8031782525cb', 'volume_name': 'volume-f6cb6981-ff86-4031-83f5-8031782525cb', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2538fcfc-c020-42ad-b300-b539714a149d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2538fcfc-c020-42ad-b300-b539714a149d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dedd3a-bb02-432b-bb0b-b7f0119757b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:45 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume f6cb6981-ff86-4031-83f5-8031782525cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6cb6981-ff86-4031-83f5-8031782525cb', 'volume_size': 1} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:45 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1" returned: 0 in 0.254s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.563s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1956749729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57fe44a4-9951-490b-a9fe-df3b946e3d4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984c990c309459fb9755cc0ffa04db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:44Z,use_quota=True,user_id='6055ac0d851e4cecb44acef9e5f0f91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Creating volume 57fe44a4-9951-490b-a9fe-df3b946e3d4f {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:45 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c792138-e822-4004-8c3e-0144003efa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7367f341-d4df-42fd-b641-a60977436fa1', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:45 devstack sudo[108284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f 1073741824 Sep 29 18:58:45 devstack sudo[108284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bdb71e-97ac-4d71-ad5f-961d8835bcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:45 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Volume volume-7367f341-d4df-42fd-b641-a60977436fa1 (7367f341-d4df-42fd-b641-a60977436fa1): created successfully Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7bdb71e-97ac-4d71-ad5f-961d8835bcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (d41074e7-ef7e-4f91-9d61-45032c8156f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:45 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8874888c-b11b-4ee2-b0a2-999e0d0aa17e tempest-ProjectMemberTests-1585924540 None] Created volume successfully. Sep 29 18:58:46 devstack sudo[108284]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f 1073741824" returned: 0 in 0.462s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:46 devstack sudo[108290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f Sep 29 18:58:46 devstack sudo[108290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:46 devstack sudo[108290]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f" returned: 0 in 0.295s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.964s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-732305282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acaea2a1-22d9-45c2-9359-b7d9e35603f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984c990c309459fb9755cc0ffa04db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:45Z,use_quota=True,user_id='6055ac0d851e4cecb44acef9e5f0f91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Creating volume acaea2a1-22d9-45c2-9359-b7d9e35603f5 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:46 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:46 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5 1073741824 Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19dbaf60-65dd-4e81-9eb7-e285f74e0b0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:46 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf4259b-3ed8-41c6-8756-f510cf2f7b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:46 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f (57fe44a4-9951-490b-a9fe-df3b946e3d4f): created successfully Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf4259b-3ed8-41c6-8756-f510cf2f7b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:46 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Flow 'volume_create_manager' (e4da7500-3f20-45e8-b1a4-72f1e42eacf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:46 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-015288ab-baba-414d-8ae6-f56640f22dd5 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Created volume successfully. Sep 29 18:58:47 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5 1073741824" returned: 0 in 0.525s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:47 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5 Sep 29 18:58:47 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:47 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5" returned: 0 in 0.258s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.239s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-62910376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8dabe14-e0a8-4f10-921d-33fa3a626cd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984c990c309459fb9755cc0ffa04db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:45Z,use_quota=True,user_id='6055ac0d851e4cecb44acef9e5f0f91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Creating volume a8dabe14-e0a8-4f10-921d-33fa3a626cd1 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:47 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:47 devstack sudo[108302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1 1073741824 Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6db03f75-0ba9-4220-9af7-354d41d06073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:47 devstack sudo[108302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd883a0c-0123-465a-a9eb-242cf479ca3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:47 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5 (acaea2a1-22d9-45c2-9359-b7d9e35603f5): created successfully Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd883a0c-0123-465a-a9eb-242cf479ca3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:47 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Flow 'volume_create_manager' (ef0c482d-0f99-4d4b-a0f1-35e3cc3e6c91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:47 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-e84df147-4801-4c9c-85aa-bbdf6d12bfca tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Created volume successfully. Sep 29 18:58:48 devstack sudo[108302]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1 1073741824" returned: 0 in 0.573s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:48 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1 Sep 29 18:58:48 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:48 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1" returned: 0 in 0.296s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] <== create_volume: return (924ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.755s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1556832781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6cb6981-ff86-4031-83f5-8031782525cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9984c990c309459fb9755cc0ffa04db4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:46Z,use_quota=True,user_id='6055ac0d851e4cecb44acef9e5f0f91b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Creating volume f6cb6981-ff86-4031-83f5-8031782525cb {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:48 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f6cb6981-ff86-4031-83f5-8031782525cb 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8c4b3e9-646f-4fe5-a8e5-77b9eda4b285) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:48 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f6cb6981-ff86-4031-83f5-8031782525cb 1073741824 Sep 29 18:58:48 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be86ca84-0d77-4643-8030-5464a8408893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:48 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1 (a8dabe14-e0a8-4f10-921d-33fa3a626cd1): created successfully Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be86ca84-0d77-4643-8030-5464a8408893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Flow 'volume_create_manager' (591b114f-54ac-4ec7-a318-7ea0d07e49d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:48 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-83b4460f-9ee6-48ef-8c56-b7621a535682 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Created volume successfully. Sep 29 18:58:48 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f6cb6981-ff86-4031-83f5-8031782525cb 1073741824" returned: 0 in 0.511s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f6cb6981-ff86-4031-83f5-8031782525cb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:49 devstack sudo[108317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f6cb6981-ff86-4031-83f5-8031782525cb Sep 29 18:58:49 devstack sudo[108317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:49 devstack sudo[108317]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f6cb6981-ff86-4031-83f5-8031782525cb" returned: 0 in 0.254s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] Creating offline snapshot a72765f5-8dcc-4ece-b373-0e37934065f5 of volume 7367f341-d4df-42fd-b641-a60977436fa1 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53dedd3a-bb02-432b-bb0b-b7f0119757b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6cb6981-ff86-4031-83f5-8031782525cb', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96410825-656b-4b3c-94f7-4524972ace65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fafe33-c059-4b2f-a78f-eb3898d6a62d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:49 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Volume volume-f6cb6981-ff86-4031-83f5-8031782525cb (f6cb6981-ff86-4031-83f5-8031782525cb): created successfully Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96410825-656b-4b3c-94f7-4524972ace65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Flow 'volume_create_manager' (21e8e393-900d-44a5-b524-70023e2cbaf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:49 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-04da56d8-4e53-4d14-bb53-c6d5a27f201b tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Created volume successfully. Sep 29 18:58:49 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1 Sep 29 18:58:49 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:49 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1" returned: 0 in 0.377s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:49 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 1G Sep 29 18:58:49 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "cinder-f6cb6981-ff86-4031-83f5-8031782525cb-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:50 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-f6cb6981-ff86-4031-83f5-8031782525cb-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 1G" returned: 0 in 0.503s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7367f341-d4df-42fd-b641-a60977436fa1 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:50 devstack sudo[108331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7367f341-d4df-42fd-b641-a60977436fa1 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 Sep 29 18:58:50 devstack sudo[108331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "cinder-quobyte-f6cb6981-ff86-4031-83f5-8031782525cb" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-quobyte-f6cb6981-ff86-4031-83f5-8031782525cb" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cba2622-df26-437e-9329-7d60a4465fdd]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f6cb6981-ff86-4031-83f5-8031782525cb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:50 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f6cb6981-ff86-4031-83f5-8031782525cb Sep 29 18:58:50 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:50 devstack sudo[108331]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7367f341-d4df-42fd-b641-a60977436fa1 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5" returned: 0 in 0.412s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:50 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 is being set with open permissions: ugo+rw Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:50 devstack sudo[108340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 Sep 29 18:58:50 devstack sudo[108340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:50 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f6cb6981-ff86-4031-83f5-8031782525cb" returned: 0 in 0.438s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f6cb6981-ff86-4031-83f5-8031782525cb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:50 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f6cb6981-ff86-4031-83f5-8031782525cb Sep 29 18:58:50 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:50 devstack sudo[108340]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5" returned: 0 in 0.273s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:50 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.info Sep 29 18:58:50 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:51 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-f6cb6981-ff86-4031-83f5-8031782525cb" returned: 0 in 0.286s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-quobyte-f6cb6981-ff86-4031-83f5-8031782525cb" released by "delete_volume" :: held 0.789s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Created reservations ['647f1c8e-46af-4637-987e-cc96ddc646a3', '584b0f31-d620-45c9-ad5e-517dd0298008', '095f0a6d-5ff9-4823-944c-4d1cfa92e79e', '071df857-5fcb-47fa-9cd5-f330a16c6aba'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:51 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.info" returned: 0 in 0.320s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:51 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.info is being set with open permissions: ugo+rw Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:51 devstack sudo[108353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.info Sep 29 18:58:51 devstack sudo[108353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:51 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:51 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "cinder-a8dabe14-e0a8-4f10-921d-33fa3a626cd1-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-a8dabe14-e0a8-4f10-921d-33fa3a626cd1-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "cinder-quobyte-a8dabe14-e0a8-4f10-921d-33fa3a626cd1" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-quobyte-a8dabe14-e0a8-4f10-921d-33fa3a626cd1" acquired by "delete_volume" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d645c4-1aef-4097-9bab-ec91dfd75893]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:51 devstack sudo[108353]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.info" returned: 0 in 0.376s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.387s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:51 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.452s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:51 devstack sudo[108356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1 Sep 29 18:58:51 devstack sudo[108356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:51 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Deleted volume successfully. Sep 29 18:58:51 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-84a385aa-5ec0-4fff-b8ed-f283cd949fcc tempest-ProjectMemberTests-1585924540 None] Create snapshot completed successfully Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-60f86380-361f-4662-9f9b-c79604d3e706 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-f6cb6981-ff86-4031-83f5-8031782525cb-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:51 devstack sudo[108356]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1" returned: 0 in 0.442s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:52 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1 Sep 29 18:58:52 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:52 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-a8dabe14-e0a8-4f10-921d-33fa3a626cd1" returned: 0 in 0.248s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-quobyte-a8dabe14-e0a8-4f10-921d-33fa3a626cd1" released by "delete_volume" :: held 0.763s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Created reservations ['abd675a7-2b39-4e8a-909c-cfdbe4052523', '9a172eba-54ac-4117-8a40-535d9f3d01b2', 'a9daf180-6bd5-4667-9c91-e9e79133d896', 'fbb4b586-64b9-4f78-a2b0-06dada85efd0'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:52 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:52 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-a72765f5-8dcc-4ece-b373-0e37934065f5-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-a72765f5-8dcc-4ece-b373-0e37934065f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-7367f341-d4df-42fd-b641-a60977436fa1" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-7367f341-d4df-42fd-b641-a60977436fa1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-a72765f5-8dcc-4ece-b373-0e37934065f5" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-a72765f5-8dcc-4ece-b373-0e37934065f5" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Deleting offline snapshot a72765f5-8dcc-4ece-b373-0e37934065f5 of volume 7367f341-d4df-42fd-b641-a60977436fa1 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] snapshot_file for this snap is: volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "cinder-acaea2a1-22d9-45c2-9359-b7d9e35603f5-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[429db22b-70ee-4c8f-ad34-daf558059e48]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:52 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.325s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-acaea2a1-22d9-45c2-9359-b7d9e35603f5-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:52 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Deleted volume successfully. Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ea3255f3-35c7-4dfc-b336-1a40b08a7914 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-a8dabe14-e0a8-4f10-921d-33fa3a626cd1-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "cinder-quobyte-acaea2a1-22d9-45c2-9359-b7d9e35603f5" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-quobyte-acaea2a1-22d9-45c2-9359-b7d9e35603f5" acquired by "delete_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:52 devstack sudo[108369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 Sep 29 18:58:52 devstack sudo[108369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[50ef76f3-ee79-4476-a01e-78d17e46a250]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:52 devstack sudo[108371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5 Sep 29 18:58:52 devstack sudo[108371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:53 devstack sudo[108369]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5" returned: 0 in 0.451s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7367f341-d4df-42fd-b641-a60977436fa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb6e3ed-3c05-44a5-b621-6be2af362fc2]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:53 devstack sudo[108371]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5" returned: 0 in 0.422s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:53 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5 Sep 29 18:58:53 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:53 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1 Sep 29 18:58:53 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:53 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-acaea2a1-22d9-45c2-9359-b7d9e35603f5" returned: 0 in 0.254s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-quobyte-acaea2a1-22d9-45c2-9359-b7d9e35603f5" released by "delete_volume" :: held 0.733s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Created reservations ['395bdbd1-da32-4b5e-b09a-89fc6e6bc330', 'c8e921b0-e3c4-487c-82bf-be51cf3743cc', '71dc3a23-f79e-44d8-8ee8-0a10c9d2fadb', '6ca5c0ae-28ea-46be-bf5a-a829d19f7e49'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:53 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1" returned: 0 in 0.441s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:53 devstack sudo[108389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 Sep 29 18:58:53 devstack sudo[108389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:53 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:53 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "cinder-57fe44a4-9951-490b-a9fe-df3b946e3d4f-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:53 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-57fe44a4-9951-490b-a9fe-df3b946e3d4f-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "cinder-quobyte-57fe44a4-9951-490b-a9fe-df3b946e3d4f" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-quobyte-57fe44a4-9951-490b-a9fe-df3b946e3d4f" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4541916-e8d3-416d-b7e0-27f7741ddc4b]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:54 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.457s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:54 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Deleted volume successfully. Sep 29 18:58:54 devstack sudo[108389]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5" returned: 0 in 0.601s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:54 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f Sep 29 18:58:54 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-636079e1-519e-4f00-9adf-789f596b0c9f tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-acaea2a1-22d9-45c2-9359-b7d9e35603f5-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:54 devstack sudo[108398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5 Sep 29 18:58:54 devstack sudo[108398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:54 devstack sudo[108398]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1.a72765f5-8dcc-4ece-b373-0e37934065f5" returned: 0 in 0.297s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:54 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-a72765f5-8dcc-4ece-b373-0e37934065f5" released by "_delete_snapshot" :: held 1.967s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f" returned: 0 in 0.488s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-7367f341-d4df-42fd-b641-a60977436fa1" released by "delete_snapshot" :: held 2.030s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:54 devstack sudo[108405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f Sep 29 18:58:54 devstack sudo[108405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Created reservations ['6c3fe03b-f9e0-4fa0-87cf-56d87247917e', '67bc58ba-e5de-4e86-a8b3-2c46b51f12d0', '89782909-efed-4c55-b304-0aed22c85454', '8fc9404e-790e-4933-8a68-cf964a5a87d9'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:54 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Delete snapshot completed successfully. Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ed2d033f-cd88-46c6-ab37-78050dfdac70 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-a72765f5-8dcc-4ece-b373-0e37934065f5-delete_snapshot" released by "delete_snapshot" :: held 2.262s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:54 devstack sudo[108405]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-57fe44a4-9951-490b-a9fe-df3b946e3d4f" returned: 0 in 0.339s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-quobyte-57fe44a4-9951-490b-a9fe-df3b946e3d4f" released by "delete_volume" :: held 0.880s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:54 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Created reservations ['b2660107-584e-4f2a-8b0b-826efe5aa2f3', '4d319b97-1d93-488b-b85b-88ebe9b9da1e', '6c7196b5-6cb2-4062-a172-1901767f459c', '6095e005-ad71-4b82-ab30-76b5fb6b1a92'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:55 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:55 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "cinder-191ee60a-d57d-43ee-bcb7-749f6a284dc7-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-191ee60a-d57d-43ee-bcb7-749f6a284dc7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "cinder-quobyte-191ee60a-d57d-43ee-bcb7-749f6a284dc7" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-quobyte-191ee60a-d57d-43ee-bcb7-749f6a284dc7" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b24bc95-4fe9-4935-bf2b-c64b094f9b21]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:55 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.271s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:55 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Deleted volume successfully. Sep 29 18:58:55 devstack sudo[108410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7 Sep 29 18:58:55 devstack sudo[108410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b93c77f2-601a-4fb4-8f99-c7bb3a6a8f89 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-57fe44a4-9951-490b-a9fe-df3b946e3d4f-delete_volume" released by "delete_volume" :: held 1.465s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:55 devstack sudo[108410]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7" returned: 0 in 0.406s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:55 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7 Sep 29 18:58:55 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-7367f341-d4df-42fd-b641-a60977436fa1-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-7367f341-d4df-42fd-b641-a60977436fa1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-7367f341-d4df-42fd-b641-a60977436fa1" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-7367f341-d4df-42fd-b641-a60977436fa1" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c25e761-601b-457b-840f-98e92d060fde]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:55 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-191ee60a-d57d-43ee-bcb7-749f6a284dc7" returned: 0 in 0.313s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-quobyte-191ee60a-d57d-43ee-bcb7-749f6a284dc7" released by "delete_volume" :: held 0.773s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Created reservations ['e8dedcc5-acd8-4235-b841-c3b482ccba24', '35df1b52-1e45-4f2a-86d4-4d0d39173532', '2a566949-830a-48da-9c58-cb65945b7c81', 'ad56a283-9036-4824-89cb-f4326633e4be'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:56 devstack sudo[108419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1 Sep 29 18:58:56 devstack sudo[108419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:56 devstack sudo[108421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:56 devstack sudo[108421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "cinder-b4ba3429-07c9-4f05-96ac-33d469ca53c7-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-b4ba3429-07c9-4f05-96ac-33d469ca53c7-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "cinder-quobyte-b4ba3429-07c9-4f05-96ac-33d469ca53c7" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-quobyte-b4ba3429-07c9-4f05-96ac-33d469ca53c7" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3271ff-d6de-492b-adf3-fd1d4a3f3150]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:56 devstack sudo[108419]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1" returned: 0 in 0.551s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:56 devstack sudo[108429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1 Sep 29 18:58:56 devstack sudo[108429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:56 devstack sudo[108421]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.394s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:56 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Deleted volume successfully. Sep 29 18:58:56 devstack sudo[108427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7 Sep 29 18:58:56 devstack sudo[108427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-6646d5b4-0cbb-4853-8bd0-6dc6b6bc7e86 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-191ee60a-d57d-43ee-bcb7-749f6a284dc7-delete_volume" released by "delete_volume" :: held 1.440s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:56 devstack sudo[108429]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-7367f341-d4df-42fd-b641-a60977436fa1" returned: 0 in 0.285s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-7367f341-d4df-42fd-b641-a60977436fa1" released by "delete_volume" :: held 0.910s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:56 devstack sudo[108427]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7" returned: 0 in 0.417s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:56 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Created reservations ['d6ecc07c-a829-4caf-b706-b0ff317b3a0b', 'f3f10820-fe6c-4994-80d4-032918060272', '723142b8-e32f-449b-8f5d-ae6228cc22d9', '46d3d0ee-bac5-419c-a541-c93e1cf4bf20'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:56 devstack sudo[108436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7 Sep 29 18:58:56 devstack sudo[108436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:57 devstack sudo[108438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:57 devstack sudo[108438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:57 devstack sudo[108436]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b4ba3429-07c9-4f05-96ac-33d469ca53c7" returned: 0 in 0.290s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-quobyte-b4ba3429-07c9-4f05-96ac-33d469ca53c7" released by "delete_volume" :: held 0.760s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Created reservations ['af6788d3-39e7-422f-91b2-116337e66376', '0569ad17-13d1-498c-9b00-8a1c2c54cc57', '061f387d-9f6f-4498-8182-25bc553cdc3d', 'b4bb8c0b-fd8d-4614-9bad-dff3d6183e35'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:58:57 devstack sudo[108438]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.257s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:57 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Deleted volume successfully. Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d6b8e15c-072a-4dc2-9317-9c821d65e6c3 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-7367f341-d4df-42fd-b641-a60977436fa1-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:57 devstack sudo[108442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:57 devstack sudo[108442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:57 devstack sudo[108442]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.275s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:57 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Deleted volume successfully. Sep 29 18:58:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-deb0f1c5-9f4a-4707-8dd3-752f0f587d31 tempest-CreateVolumesFromSourceVolumeTest-109230597 None] Lock "cinder-b4ba3429-07c9-4f05-96ac-33d469ca53c7-delete_volume" released by "delete_volume" :: held 1.306s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:58:58 devstack sudo[108445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:58:58 devstack sudo[108445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (08a634d5-98b0-40d5-8b88-1e394ce59d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d640d6f6-a447-48ef-8271-efeb51f81359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d640d6f6-a447-48ef-8271-efeb51f81359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403037556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcd9a0c-452e-4520-8882-2755ba624115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:59Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a640dd5b-ea59-4b7e-8c3d-e16ad60256e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a640dd5b-ea59-4b7e-8c3d-e16ad60256e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a73b7d-3a8f-48c2-8978-65b3939b0507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a73b7d-3a8f-48c2-8978-65b3939b0507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2bcd9a0c-452e-4520-8882-2755ba624115', 'volume_name': 'volume-2bcd9a0c-452e-4520-8882-2755ba624115', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f605931a-659d-4ef1-99ce-c392a34a84ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f605931a-659d-4ef1-99ce-c392a34a84ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2673926-dbba-4a41-82d6-3bf4a26838a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:58 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Volume 2bcd9a0c-452e-4520-8882-2755ba624115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2bcd9a0c-452e-4520-8882-2755ba624115', 'volume_size': 1} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403037556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2bcd9a0c-452e-4520-8882-2755ba624115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:58:59Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Creating volume 2bcd9a0c-452e-4520-8882-2755ba624115 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:58:58 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:58:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:58 devstack sudo[108448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115 1073741824 Sep 29 18:58:58 devstack sudo[108448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:59 devstack sudo[108445]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.383s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:58:59 devstack sudo[108448]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115 1073741824" returned: 0 in 0.553s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:58:59 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115 Sep 29 18:58:59 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:58:59 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115" returned: 0 in 0.312s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.951s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2673926-dbba-4a41-82d6-3bf4a26838a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2bcd9a0c-452e-4520-8882-2755ba624115', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e31f46-b29b-49d0-abbd-ef3071bb5076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:58:59 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Volume volume-2bcd9a0c-452e-4520-8882-2755ba624115 (2bcd9a0c-452e-4520-8882-2755ba624115): created successfully Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9e31f46-b29b-49d0-abbd-ef3071bb5076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:58:59 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (08a634d5-98b0-40d5-8b88-1e394ce59d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:58:59 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8ad3dc56-cf08-4ed6-9db9-1ebb94e444d4 tempest-ProjectMemberTests-1585924540 None] Created volume successfully. Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] Creating offline snapshot a64590b4-516d-4e94-ac04-942d0a9772af of volume 2bcd9a0c-452e-4520-8882-2755ba624115 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb0a447-bb7c-4a71-8c4b-e3f2f91ec838]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:01 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115 Sep 29 18:59:01 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:01 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115" returned: 0 in 0.437s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:01 devstack sudo[108470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af 1G Sep 29 18:59:01 devstack sudo[108470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Flow 'volume_create_manager' (18736f13-9368-43e4-baf6-3bd66fad95bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82507ad9-f7b7-47c7-b8f1-98b74ace1224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82507ad9-f7b7-47c7-b8f1-98b74ace1224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956003789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46eab3dc-013d-43ff-9775-e4605bc85a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834c815971d4470ba59f47c1aa514019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:02Z,use_quota=True,user_id='c5103c488a7144adb6c424a8ea928b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e583f8da-468a-4494-ab40-7ce3cdd7f239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e583f8da-468a-4494-ab40-7ce3cdd7f239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a9590f-c99a-4e62-975a-7e9bd65bbdd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9a9590f-c99a-4e62-975a-7e9bd65bbdd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46eab3dc-013d-43ff-9775-e4605bc85a67', 'volume_name': 'volume-46eab3dc-013d-43ff-9775-e4605bc85a67', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b31a28-6a32-4567-947a-6beb2c369602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8b31a28-6a32-4567-947a-6beb2c369602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed23bba4-ba86-4b1f-b7f9-d13455d38e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:01 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Volume 46eab3dc-013d-43ff-9775-e4605bc85a67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46eab3dc-013d-43ff-9775-e4605bc85a67', 'volume_size': 1} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:01 devstack sudo[108470]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af 1G" returned: 0 in 0.492s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcd9a0c-452e-4520-8882-2755ba624115 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:02 devstack sudo[108476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcd9a0c-452e-4520-8882-2755ba624115 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af Sep 29 18:59:02 devstack sudo[108476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:02 devstack sudo[108476]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2bcd9a0c-452e-4520-8882-2755ba624115 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af" returned: 0 in 0.315s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:02 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af is being set with open permissions: ugo+rw Sep 29 18:59:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:02 devstack sudo[108481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af Sep 29 18:59:02 devstack sudo[108481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:02 devstack sudo[108481]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af" returned: 0 in 0.262s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:02 devstack sudo[108484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.info Sep 29 18:59:02 devstack sudo[108484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:02 devstack sudo[108484]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.info" returned: 0 in 0.277s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:02 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.info is being set with open permissions: ugo+rw Sep 29 18:59:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:02 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.info Sep 29 18:59:02 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:03 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.info" returned: 0 in 0.292s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.353s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1956003789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46eab3dc-013d-43ff-9775-e4605bc85a67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834c815971d4470ba59f47c1aa514019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:02Z,use_quota=True,user_id='c5103c488a7144adb6c424a8ea928b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Creating volume 46eab3dc-013d-43ff-9775-e4605bc85a67 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:59:03 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:03 devstack sudo[108526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67 1073741824 Sep 29 18:59:03 devstack sudo[108526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:03 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-295b2902-6248-4a5b-affa-ee3bca10664f tempest-ProjectMemberTests-1585924540 None] Create snapshot completed successfully Sep 29 18:59:03 devstack sudo[108526]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67 1073741824" returned: 0 in 0.462s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:03 devstack sudo[108533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67 Sep 29 18:59:03 devstack sudo[108533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:04 devstack sudo[108533]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67" returned: 0 in 0.286s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed23bba4-ba86-4b1f-b7f9-d13455d38e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46eab3dc-013d-43ff-9775-e4605bc85a67', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863aff81-eff8-4b57-ac56-dc7396d21e6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:04 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Volume volume-46eab3dc-013d-43ff-9775-e4605bc85a67 (46eab3dc-013d-43ff-9775-e4605bc85a67): created successfully Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863aff81-eff8-4b57-ac56-dc7396d21e6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Flow 'volume_create_manager' (18736f13-9368-43e4-baf6-3bd66fad95bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:04 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-329ed124-704a-4cf9-808e-578f926c39f4 tempest-ProjectReaderTests-1845436779 None] Created volume successfully. Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-a64590b4-516d-4e94-ac04-942d0a9772af-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-a64590b4-516d-4e94-ac04-942d0a9772af-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-2bcd9a0c-452e-4520-8882-2755ba624115" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-2bcd9a0c-452e-4520-8882-2755ba624115" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-a64590b4-516d-4e94-ac04-942d0a9772af" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-a64590b4-516d-4e94-ac04-942d0a9772af" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Deleting offline snapshot a64590b4-516d-4e94-ac04-942d0a9772af of volume 2bcd9a0c-452e-4520-8882-2755ba624115 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] snapshot_file for this snap is: volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23d6ec8-4fde-4742-a2ee-963ec1d718af]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:04 devstack sudo[108536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af Sep 29 18:59:04 devstack sudo[108536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:04 devstack sudo[108536]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af" returned: 0 in 0.378s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2bcd9a0c-452e-4520-8882-2755ba624115(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[208e3022-e63b-4944-a403-2ad619858aa8]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:04 devstack sudo[108541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115 Sep 29 18:59:04 devstack sudo[108541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Flow 'volume_create_manager' (eadf87f7-3683-4cad-81fc-c1b20ac7da47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00be7310-9366-485b-b61f-48e4409625fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:05 devstack sudo[108541]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115" returned: 0 in 0.471s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00be7310-9366-485b-b61f-48e4409625fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1968379203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de811860-0019-4a18-b6f8-5d1764bc2458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a4360e1141436ea0bfd838e179eb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:05Z,use_quota=True,user_id='34f616832e44433fb8e672f843753482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c065d1c-141d-4918-b834-3ae2c1ac6bd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:05 devstack sudo[108546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af Sep 29 18:59:05 devstack sudo[108546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c065d1c-141d-4918-b834-3ae2c1ac6bd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364863ff-a9b5-4737-801d-3ba580743401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (364863ff-a9b5-4737-801d-3ba580743401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de811860-0019-4a18-b6f8-5d1764bc2458', 'volume_name': 'volume-de811860-0019-4a18-b6f8-5d1764bc2458', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922526f0-4b4e-40f7-9d5b-ddae45f19b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (922526f0-4b4e-40f7-9d5b-ddae45f19b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e814463f-81f6-424c-b678-9dc54170ae94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:05 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Volume de811860-0019-4a18-b6f8-5d1764bc2458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de811860-0019-4a18-b6f8-5d1764bc2458', 'volume_size': 1} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1968379203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de811860-0019-4a18-b6f8-5d1764bc2458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a4360e1141436ea0bfd838e179eb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:05Z,use_quota=True,user_id='34f616832e44433fb8e672f843753482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Creating volume de811860-0019-4a18-b6f8-5d1764bc2458 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:59:05 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:05 devstack sudo[108548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 1073741824 Sep 29 18:59:05 devstack sudo[108548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:05 devstack sudo[108546]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af" returned: 0 in 0.348s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:05 devstack sudo[108556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af Sep 29 18:59:05 devstack sudo[108556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:05 devstack sudo[108548]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 1073741824" returned: 0 in 0.439s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:05 devstack sudo[108558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 Sep 29 18:59:05 devstack sudo[108558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:05 devstack sudo[108556]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115.a64590b4-516d-4e94-ac04-942d0a9772af" returned: 0 in 0.270s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-a64590b4-516d-4e94-ac04-942d0a9772af" released by "_delete_snapshot" :: held 1.599s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-2bcd9a0c-452e-4520-8882-2755ba624115" released by "delete_snapshot" :: held 1.626s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:05 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Created reservations ['a8047c83-7f9f-47d7-90b3-1c7c16dcaa9a', '8d653d65-05b5-4446-8753-5972fe66cd81', '0342a1e6-69f2-4680-b830-06a2177ef06d', 'db7c8d25-f39e-4475-a5ea-b9593b2e77cf'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:06 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Delete snapshot completed successfully. Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a52a46d4-1f8d-46f4-a34d-558e61efb957 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-a64590b4-516d-4e94-ac04-942d0a9772af-delete_snapshot" released by "delete_snapshot" :: held 1.777s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:06 devstack sudo[108558]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458" returned: 0 in 0.293s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.741s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e814463f-81f6-424c-b678-9dc54170ae94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de811860-0019-4a18-b6f8-5d1764bc2458', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e3ada2-6e4a-4404-9bf5-bab972f392d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] Creating offline snapshot f10be36d-6409-443c-9ba2-3b1c0ea7e0ca of volume 46eab3dc-013d-43ff-9775-e4605bc85a67 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a925f2b3-eb74-4b66-9dc8-4631b8be852f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:06 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Volume volume-de811860-0019-4a18-b6f8-5d1764bc2458 (de811860-0019-4a18-b6f8-5d1764bc2458): created successfully Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (78e3ada2-6e4a-4404-9bf5-bab972f392d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Flow 'volume_create_manager' (eadf87f7-3683-4cad-81fc-c1b20ac7da47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:06 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-095a7a02-8a22-4a8b-b527-dece0bec9e4d tempest-SnapshotDependencyTests-754721868 None] Created volume successfully. Sep 29 18:59:06 devstack sudo[108562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67 Sep 29 18:59:06 devstack sudo[108562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-2bcd9a0c-452e-4520-8882-2755ba624115-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-2bcd9a0c-452e-4520-8882-2755ba624115-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-2bcd9a0c-452e-4520-8882-2755ba624115" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-2bcd9a0c-452e-4520-8882-2755ba624115" acquired by "delete_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a10d64-4998-4606-a6b9-4a984d57bd42]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:06 devstack sudo[108562]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67" returned: 0 in 0.444s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:06 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca 1G Sep 29 18:59:06 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:06 devstack sudo[108567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115 Sep 29 18:59:06 devstack sudo[108567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:06 devstack sudo[108567]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115" returned: 0 in 0.445s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:07 devstack sudo[108577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115 Sep 29 18:59:07 devstack sudo[108577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:07 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca 1G" returned: 0 in 0.528s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46eab3dc-013d-43ff-9775-e4605bc85a67 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:07 devstack sudo[108580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46eab3dc-013d-43ff-9775-e4605bc85a67 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca Sep 29 18:59:07 devstack sudo[108580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:07 devstack sudo[108577]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-2bcd9a0c-452e-4520-8882-2755ba624115" returned: 0 in 0.308s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-2bcd9a0c-452e-4520-8882-2755ba624115" released by "delete_volume" :: held 0.844s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Created reservations ['0cbcf182-3875-4c11-93cc-ab34024aec76', '99194398-ec62-4095-97b1-7133243957d9', 'c6bf57e2-841f-406f-9062-81f0c0ea184b', '38583799-a8e1-4a60-9da4-50292a4ef08b'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:07 devstack sudo[108580]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46eab3dc-013d-43ff-9775-e4605bc85a67 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca" returned: 0 in 0.413s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:07 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca is being set with open permissions: ugo+rw Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:07 devstack sudo[108588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:07 devstack sudo[108588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:07 devstack sudo[108589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca Sep 29 18:59:07 devstack sudo[108589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:07 devstack sudo[108588]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.261s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:07 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Deleted volume successfully. Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c165aeee-1a7a-4f24-a9f4-1873925285e0 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-2bcd9a0c-452e-4520-8882-2755ba624115-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:07 devstack sudo[108589]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca" returned: 0 in 0.288s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:07 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:07 devstack sudo[108594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.info Sep 29 18:59:07 devstack sudo[108594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (fa4f201e-b7a9-44cc-8c41-066e51b7a274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5f72c3-5e37-41e3-8dbb-c862934d71ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:08 devstack sudo[108594]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.info" returned: 0 in 0.282s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:08 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.info is being set with open permissions: ugo+rw Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb5f72c3-5e37-41e3-8dbb-c862934d71ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1882463513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767eb2b6-77cf-4042-af5f-5b6164284c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:08Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea7e0ca-5b2a-4e46-9f89-5a7d97106712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:08 devstack sudo[108597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.info Sep 29 18:59:08 devstack sudo[108597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ea7e0ca-5b2a-4e46-9f89-5a7d97106712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f152ca3-0e6b-4442-a19f-1f423fccd242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f152ca3-0e6b-4442-a19f-1f423fccd242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '767eb2b6-77cf-4042-af5f-5b6164284c4f', 'volume_name': 'volume-767eb2b6-77cf-4042-af5f-5b6164284c4f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f278e3-610c-4fa8-90f3-8cd04af45a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f278e3-610c-4fa8-90f3-8cd04af45a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd662f04-d996-46db-a931-fb7606369fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:08 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Volume 767eb2b6-77cf-4042-af5f-5b6164284c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-767eb2b6-77cf-4042-af5f-5b6164284c4f', 'volume_size': 1} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:08 devstack sudo[108597]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.info" returned: 0 in 0.243s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.308s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.819s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] Creating offline snapshot 33c1596c-cfff-4f56-8452-0422aa222505 of volume de811860-0019-4a18-b6f8-5d1764bc2458 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:59:08 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-87963bce-9bbb-4101-b9b7-c63be533ca87 tempest-ProjectReaderTests-1845436779 None] Create snapshot completed successfully Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e9c23f-9523-4689-bab9-747a8f4714a4]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:08 devstack sudo[108600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 Sep 29 18:59:08 devstack sudo[108600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:08 devstack sudo[108600]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458" returned: 0 in 0.364s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:08 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:08 devstack sudo[108605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 1G Sep 29 18:59:08 devstack sudo[108605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:09 devstack sudo[108605]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 1G" returned: 0 in 0.405s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de811860-0019-4a18-b6f8-5d1764bc2458 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:09 devstack sudo[108610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de811860-0019-4a18-b6f8-5d1764bc2458 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 Sep 29 18:59:09 devstack sudo[108610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-f10be36d-6409-443c-9ba2-3b1c0ea7e0ca-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-f10be36d-6409-443c-9ba2-3b1c0ea7e0ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-46eab3dc-013d-43ff-9775-e4605bc85a67" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-46eab3dc-013d-43ff-9775-e4605bc85a67" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-f10be36d-6409-443c-9ba2-3b1c0ea7e0ca" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-f10be36d-6409-443c-9ba2-3b1c0ea7e0ca" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Deleting offline snapshot f10be36d-6409-443c-9ba2-3b1c0ea7e0ca of volume 46eab3dc-013d-43ff-9775-e4605bc85a67 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] snapshot_file for this snap is: volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:59:09 devstack sudo[108610]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de811860-0019-4a18-b6f8-5d1764bc2458 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505" returned: 0 in 0.329s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:09 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 is being set with open permissions: ugo+rw Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1c1fc3a-9c6a-4b15-b402-1ad887fa4e08]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:09 devstack sudo[108616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 Sep 29 18:59:09 devstack sudo[108616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:09 devstack sudo[108617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca Sep 29 18:59:09 devstack sudo[108617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:09 devstack sudo[108616]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505" returned: 0 in 0.251s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:09 devstack sudo[108621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.info Sep 29 18:59:09 devstack sudo[108621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:09 devstack sudo[108617]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca" returned: 0 in 0.378s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46eab3dc-013d-43ff-9775-e4605bc85a67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9b46d4-7e75-42f7-a007-d25096c2e006]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:09 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:10 devstack sudo[108626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67 Sep 29 18:59:10 devstack sudo[108626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:10 devstack sudo[108621]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.info" returned: 0 in 0.277s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:10 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.info is being set with open permissions: ugo+rw Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:10 devstack sudo[108629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.info Sep 29 18:59:10 devstack sudo[108629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:10 devstack sudo[108626]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67" returned: 0 in 0.360s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:10 devstack sudo[108635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca Sep 29 18:59:10 devstack sudo[108635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:10 devstack sudo[108629]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.info" returned: 0 in 0.257s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.984s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.192s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1882463513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=767eb2b6-77cf-4042-af5f-5b6164284c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:08Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Creating volume 767eb2b6-77cf-4042-af5f-5b6164284c4f {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:59:10 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:10 devstack sudo[108637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f 1073741824 Sep 29 18:59:10 devstack sudo[108637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:10 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-5549c031-bcd1-4e88-ab72-5b3029c11441 tempest-SnapshotDependencyTests-754721868 None] Create snapshot completed successfully Sep 29 18:59:10 devstack sudo[108635]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca" returned: 0 in 0.380s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:10 devstack sudo[108645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca Sep 29 18:59:10 devstack sudo[108645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:10 devstack sudo[108637]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f 1073741824" returned: 0 in 0.458s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:10 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f Sep 29 18:59:10 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:10 devstack sudo[108645]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67.f10be36d-6409-443c-9ba2-3b1c0ea7e0ca" returned: 0 in 0.266s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:10 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-f10be36d-6409-443c-9ba2-3b1c0ea7e0ca" released by "_delete_snapshot" :: held 1.505s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-46eab3dc-013d-43ff-9775-e4605bc85a67" released by "delete_snapshot" :: held 1.535s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Created reservations ['150421a2-0dd7-4c84-a46c-46208bb5a550', '3ecb9a37-8652-4880-ad9c-a3ddc5f2f4f0', '9e97e53f-c5d4-455a-b875-7f214d70af1b', 'c48613f3-b652-4787-9038-5c717356880e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:11 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Delete snapshot completed successfully. Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-992ce877-f878-4ea8-8899-90b655c3e293 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-f10be36d-6409-443c-9ba2-3b1c0ea7e0ca-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:11 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f" returned: 0 in 0.310s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.824s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd662f04-d996-46db-a931-fb7606369fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-767eb2b6-77cf-4042-af5f-5b6164284c4f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d801a62-53ed-4bc6-8a3d-bcde2731f104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:11 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Volume volume-767eb2b6-77cf-4042-af5f-5b6164284c4f (767eb2b6-77cf-4042-af5f-5b6164284c4f): created successfully Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d801a62-53ed-4bc6-8a3d-bcde2731f104) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (fa4f201e-b7a9-44cc-8c41-066e51b7a274) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:11 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-684c9690-410a-4f3c-bb6d-b7d623e6dfe3 tempest-ProjectMemberTests-1585924540 None] Created volume successfully. Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Flow 'volume_create_manager' (c7c86e8c-e61b-4490-a4c0-bebc748203c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a95ca8-743d-4326-823c-85ecf30eff10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05a95ca8-743d-4326-823c-85ecf30eff10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:11Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39f95bf2-e578-4170-a434-b46c1cd3eca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82a4360e1141436ea0bfd838e179eb0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=33c1596c-cfff-4f56-8452-0422aa222505,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:11Z,use_quota=True,user_id='34f616832e44433fb8e672f843753482',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54793249-5c82-4af0-9156-c8b3b4af8c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54793249-5c82-4af0-9156-c8b3b4af8c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469a7bda-c3b0-4124-97a9-610e97fa3e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (469a7bda-c3b0-4124-97a9-610e97fa3e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '39f95bf2-e578-4170-a434-b46c1cd3eca9', 'volume_name': 'volume-39f95bf2-e578-4170-a434-b46c1cd3eca9', 'volume_size': 1, 'snapshot_id': '33c1596c-cfff-4f56-8452-0422aa222505'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e107ce4c-ee28-449e-9b2e-be05d44ba14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e107ce4c-ee28-449e-9b2e-be05d44ba14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f096e73-2200-49de-8d19-0c1067ab030b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:11 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Volume 39f95bf2-e578-4170-a434-b46c1cd3eca9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-39f95bf2-e578-4170-a434-b46c1cd3eca9', 'volume_size': 1, 'snapshot_id': '33c1596c-cfff-4f56-8452-0422aa222505'} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "cinder-quobyte-33c1596c-cfff-4f56-8452-0422aa222505-39f95bf2-e578-4170-a434-b46c1cd3eca9" by "_create_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-quobyte-33c1596c-cfff-4f56-8452-0422aa222505-39f95bf2-e578-4170-a434-b46c1cd3eca9" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Creating volume 39f95bf2-e578-4170-a434-b46c1cd3eca9 from snapshot 33c1596c-cfff-4f56-8452-0422aa222505 {{(pid=86523) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "cinder-quobyte-39f95bf2-e578-4170-a434-b46c1cd3eca9" by "_copy_volume_from_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-quobyte-39f95bf2-e578-4170-a434-b46c1cd3eca9" acquired by "_copy_volume_from_snapshot" :: waited 0.011s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] snapshot: 33c1596c-cfff-4f56-8452-0422aa222505, volume: 39f95bf2-e578-4170-a434-b46c1cd3eca9, {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4f7d43-4020-4b22-84a0-3c63d2c6a57c]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-46eab3dc-013d-43ff-9775-e4605bc85a67-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-46eab3dc-013d-43ff-9775-e4605bc85a67-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:11 devstack sudo[108652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 Sep 29 18:59:11 devstack sudo[108652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-46eab3dc-013d-43ff-9775-e4605bc85a67" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-46eab3dc-013d-43ff-9775-e4605bc85a67" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22ab10a-5ab0-49ea-9977-0fffe6c97881]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:11 devstack sudo[108654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67 Sep 29 18:59:11 devstack sudo[108654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:11 devstack sudo[108652]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505" returned: 0 in 0.371s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de811860-0019-4a18-b6f8-5d1764bc2458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d2983ce-6cf8-45b9-8d03-07a2631bf8d3]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:11 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:12 devstack sudo[108659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 Sep 29 18:59:12 devstack sudo[108659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:12 devstack sudo[108654]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67" returned: 0 in 0.369s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:12 devstack sudo[108664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67 Sep 29 18:59:12 devstack sudo[108664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:12 devstack sudo[108659]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458" returned: 0 in 0.395s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Creating direct copy from snapshot {{(pid=86523) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG cinder.utils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Path /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9 not found in is_blk_device check {{(pid=86523) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:12 devstack sudo[108670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9 Sep 29 18:59:12 devstack sudo[108670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:12 devstack sudo[108664]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-46eab3dc-013d-43ff-9775-e4605bc85a67" returned: 0 in 0.265s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-46eab3dc-013d-43ff-9775-e4605bc85a67" released by "delete_volume" :: held 0.711s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Created reservations ['0e01e27e-f68e-43aa-a035-f2fd766cf6ae', 'c4e57b82-eb74-4f27-b3dc-990ef85d67b7', 'e0c5ce7a-1ebb-45f5-8827-79a78883d18b', '09702ea1-c53b-4d75-b2b1-21f6c4061720'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:12 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:12 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:12 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.273s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:12 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Deleted volume successfully. Sep 29 18:59:12 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b2d31aa4-7ca3-45bd-9038-2c4fcd00f6f1 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-46eab3dc-013d-43ff-9775-e4605bc85a67-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:13 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:59:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Flow 'volume_create_manager' (2fc655a3-71d3-4609-bffe-38a1a300e431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845b138c-ebce-4312-8a0a-04409f05a4db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (845b138c-ebce-4312-8a0a-04409f05a4db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699896517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a33430f-594d-4539-a910-fd883f25f18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834c815971d4470ba59f47c1aa514019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:13Z,use_quota=True,user_id='c5103c488a7144adb6c424a8ea928b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2abc3cdc-279c-4788-910f-5a4407c89d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2abc3cdc-279c-4788-910f-5a4407c89d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1494397e-0eaa-4747-a85b-616cc28c70b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1494397e-0eaa-4747-a85b-616cc28c70b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a33430f-594d-4539-a910-fd883f25f18f', 'volume_name': 'volume-3a33430f-594d-4539-a910-fd883f25f18f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1643365c-0923-42dc-bbbf-b5d6bab4df4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1643365c-0923-42dc-bbbf-b5d6bab4df4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:13 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b52cec6-ea07-408b-bbcf-0da2a8370cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:13 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Volume 3a33430f-594d-4539-a910-fd883f25f18f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a33430f-594d-4539-a910-fd883f25f18f', 'volume_size': 1} Sep 29 18:59:13 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:18 devstack sudo[108670]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9" returned: 0 in 6.352s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:18 devstack cinder-volume[86523]: DEBUG cinder.image.image_utils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Image conversion details: src /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458, size 1024.00 MB, duration 6.35 sec, destination /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9 {{(pid=86523) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 29 18:59:18 devstack cinder-volume[86523]: INFO cinder.image.image_utils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Converted 1024.00 MB image at 161.16 MB/s Sep 29 18:59:18 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9 is being set with open permissions: ugo+rw Sep 29 18:59:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:18 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9 Sep 29 18:59:18 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:18 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9" returned: 0 in 0.242s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-quobyte-39f95bf2-e578-4170-a434-b46c1cd3eca9" released by "_copy_volume_from_snapshot" :: held 7.449s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:18 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-quobyte-33c1596c-cfff-4f56-8452-0422aa222505-39f95bf2-e578-4170-a434-b46c1cd3eca9" released by "_create_volume_from_snapshot" :: held 7.507s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.521s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.460s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] Creating offline snapshot 18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 of volume 767eb2b6-77cf-4042-af5f-5b6164284c4f {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:59:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f096e73-2200-49de-8d19-0c1067ab030b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39f95bf2-e578-4170-a434-b46c1cd3eca9', 'volume_size': 1, 'snapshot_id': '33c1596c-cfff-4f56-8452-0422aa222505'}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71da92d8-864d-4cb1-aa50-955b081b7b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:19 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[26efbd48-ddf6-4975-b52b-7042ef0cc3b3]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:19 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Volume volume-39f95bf2-e578-4170-a434-b46c1cd3eca9 (39f95bf2-e578-4170-a434-b46c1cd3eca9): created successfully Sep 29 18:59:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71da92d8-864d-4cb1-aa50-955b081b7b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:19 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Flow 'volume_create_manager' (c7c86e8c-e61b-4490-a4c0-bebc748203c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:19 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-34fc99b5-1021-4746-bb80-b78ddc08cf2b tempest-SnapshotDependencyTests-754721868 None] Created volume successfully. Sep 29 18:59:19 devstack sudo[108690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f Sep 29 18:59:19 devstack sudo[108690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:19 devstack sudo[108690]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f" returned: 0 in 0.366s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:19 devstack sudo[108695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 1G Sep 29 18:59:19 devstack sudo[108695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:19 devstack sudo[108695]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 1G" returned: 0 in 0.394s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-767eb2b6-77cf-4042-af5f-5b6164284c4f -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:19 devstack sudo[108701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-767eb2b6-77cf-4042-af5f-5b6164284c4f -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 Sep 29 18:59:19 devstack sudo[108701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "cinder-33c1596c-cfff-4f56-8452-0422aa222505-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-33c1596c-cfff-4f56-8452-0422aa222505-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "cinder-quobyte-de811860-0019-4a18-b6f8-5d1764bc2458" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-quobyte-de811860-0019-4a18-b6f8-5d1764bc2458" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "cinder-quobyte-33c1596c-cfff-4f56-8452-0422aa222505" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-quobyte-33c1596c-cfff-4f56-8452-0422aa222505" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Deleting offline snapshot 33c1596c-cfff-4f56-8452-0422aa222505 of volume de811860-0019-4a18-b6f8-5d1764bc2458 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:59:20 devstack sudo[108701]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] snapshot_file for this snap is: volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-767eb2b6-77cf-4042-af5f-5b6164284c4f -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4" returned: 0 in 0.323s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:20 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 is being set with open permissions: ugo+rw Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8181a7-25a9-49e2-85c6-59ff78ede54a]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:20 devstack sudo[108706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 Sep 29 18:59:20 devstack sudo[108706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:20 devstack sudo[108707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 Sep 29 18:59:20 devstack sudo[108707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:20 devstack sudo[108706]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4" returned: 0 in 0.244s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:20 devstack sudo[108711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.info Sep 29 18:59:20 devstack sudo[108711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:20 devstack sudo[108707]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505" returned: 0 in 0.403s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de811860-0019-4a18-b6f8-5d1764bc2458(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c030d7b2-136a-4ebd-99a7-48218cce8336]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:20 devstack sudo[108711]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.info" returned: 0 in 0.260s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:20 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.info is being set with open permissions: ugo+rw Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:20 devstack sudo[108718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.info Sep 29 18:59:20 devstack sudo[108718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:20 devstack sudo[108716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 Sep 29 18:59:20 devstack sudo[108716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:20 devstack sudo[108718]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.info" returned: 0 in 0.261s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.941s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.197s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-699896517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a33430f-594d-4539-a910-fd883f25f18f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834c815971d4470ba59f47c1aa514019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:13Z,use_quota=True,user_id='c5103c488a7144adb6c424a8ea928b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Creating volume 3a33430f-594d-4539-a910-fd883f25f18f {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:59:20 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:59:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:20 devstack sudo[108724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f 1073741824 Sep 29 18:59:20 devstack sudo[108724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-9b81584c-7a36-4402-99c6-cc7a0695c538 tempest-ProjectMemberTests-1585924540 None] Create snapshot completed successfully Sep 29 18:59:21 devstack sudo[108716]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458" returned: 0 in 0.572s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:21 devstack sudo[108727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 Sep 29 18:59:21 devstack sudo[108727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:21 devstack sudo[108724]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f 1073741824" returned: 0 in 0.443s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:21 devstack sudo[108735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f Sep 29 18:59:21 devstack sudo[108735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:21 devstack sudo[108727]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505" returned: 0 in 0.393s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:21 devstack sudo[108738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505 Sep 29 18:59:21 devstack sudo[108738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:21 devstack sudo[108735]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f" returned: 0 in 0.257s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b52cec6-ea07-408b-bbcf-0da2a8370cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a33430f-594d-4539-a910-fd883f25f18f', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d59038-b4cf-468f-8ba6-39a8c41c05cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:21 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Volume volume-3a33430f-594d-4539-a910-fd883f25f18f (3a33430f-594d-4539-a910-fd883f25f18f): created successfully Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d59038-b4cf-468f-8ba6-39a8c41c05cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Flow 'volume_create_manager' (2fc655a3-71d3-4609-bffe-38a1a300e431) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:21 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-db4a4298-87eb-4345-9218-93480c2c4505 tempest-ProjectReaderTests-1845436779 None] Created volume successfully. Sep 29 18:59:21 devstack sudo[108738]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458.33c1596c-cfff-4f56-8452-0422aa222505" returned: 0 in 0.261s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-quobyte-33c1596c-cfff-4f56-8452-0422aa222505" released by "_delete_snapshot" :: held 1.734s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-quobyte-de811860-0019-4a18-b6f8-5d1764bc2458" released by "delete_snapshot" :: held 1.755s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Created reservations ['47281802-d919-4388-8e44-0b942dc0af0e', '6e66cbc7-8a46-4263-84c5-7c77a92781ef', '9e684854-70d5-46eb-bc38-3f51b9e46c23', '21cb5980-3393-43d3-ba7f-c65a3bb570a6'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:21 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Delete snapshot completed successfully. Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-41976c93-a119-40db-bb95-181d29d5007b tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-33c1596c-cfff-4f56-8452-0422aa222505-delete_snapshot" released by "delete_snapshot" :: held 1.937s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Lock "cinder-18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-767eb2b6-77cf-4042-af5f-5b6164284c4f" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-767eb2b6-77cf-4042-af5f-5b6164284c4f" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Deleting offline snapshot 18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 of volume 767eb2b6-77cf-4042-af5f-5b6164284c4f {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] snapshot_file for this snap is: volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[79897b94-0951-4f2f-9f69-06ad8b3d5fa3]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] Creating offline snapshot 5933e93a-6c2e-4806-9b01-87d679476151 of volume 3a33430f-594d-4539-a910-fd883f25f18f {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "cinder-de811860-0019-4a18-b6f8-5d1764bc2458-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9174db5a-5a54-4216-bae3-cd72d02a2d81]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-de811860-0019-4a18-b6f8-5d1764bc2458-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:22 devstack sudo[108742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 Sep 29 18:59:22 devstack sudo[108742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "cinder-quobyte-de811860-0019-4a18-b6f8-5d1764bc2458" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-quobyte-de811860-0019-4a18-b6f8-5d1764bc2458" acquired by "delete_volume" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53487b1-0af7-409d-b06b-d92993a5c5cb]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:22 devstack sudo[108743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f Sep 29 18:59:22 devstack sudo[108743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:22 devstack sudo[108746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 Sep 29 18:59:22 devstack sudo[108746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:22 devstack sudo[108742]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4" returned: 0 in 0.453s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-767eb2b6-77cf-4042-af5f-5b6164284c4f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[79f12d7a-1087-4d73-9735-5adfc6e3f357]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:22 devstack sudo[108743]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f" returned: 0 in 0.430s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:22 devstack sudo[108756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 1G Sep 29 18:59:22 devstack sudo[108756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:22 devstack sudo[108755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f Sep 29 18:59:22 devstack sudo[108755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:22 devstack sudo[108746]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458" returned: 0 in 0.427s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:22 devstack sudo[108762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458 Sep 29 18:59:22 devstack sudo[108762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:22 devstack sudo[108755]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f" returned: 0 in 0.411s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:23 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 Sep 29 18:59:23 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:23 devstack sudo[108762]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-de811860-0019-4a18-b6f8-5d1764bc2458" returned: 0 in 0.289s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-quobyte-de811860-0019-4a18-b6f8-5d1764bc2458" released by "delete_volume" :: held 0.785s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:23 devstack sudo[108756]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 1G" returned: 0 in 0.447s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a33430f-594d-4539-a910-fd883f25f18f -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:23 devstack sudo[108774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a33430f-594d-4539-a910-fd883f25f18f -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 Sep 29 18:59:23 devstack sudo[108774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Created reservations ['20d7366a-784f-4cf0-ad28-f33a81884f48', '515e3300-100a-4c2b-9756-ffb87107460d', 'b20ec087-dc32-4b8d-aca6-0c61b5f70bb2', 'ddc0e808-0292-4d73-89e0-3f20c0913f97'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:23 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:23 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "cinder-39f95bf2-e578-4170-a434-b46c1cd3eca9-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:23 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4" returned: 0 in 0.429s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-39f95bf2-e578-4170-a434-b46c1cd3eca9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:23 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4 Sep 29 18:59:23 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "cinder-quobyte-39f95bf2-e578-4170-a434-b46c1cd3eca9" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-quobyte-39f95bf2-e578-4170-a434-b46c1cd3eca9" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:23 devstack sudo[108774]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a33430f-594d-4539-a910-fd883f25f18f -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151" returned: 0 in 0.431s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:23 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 is being set with open permissions: ugo+rw Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a922eb-996c-458a-a262-4c8b45297ddf]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:23 devstack sudo[108787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 Sep 29 18:59:23 devstack sudo[108787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:23 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.320s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:23 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Deleted volume successfully. Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-138dcf50-0fc7-4ed9-befa-11f2afa9e10d tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-de811860-0019-4a18-b6f8-5d1764bc2458-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:23 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9 Sep 29 18:59:23 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:23 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f.18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4" returned: 0 in 0.309s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4" released by "_delete_snapshot" :: held 1.725s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-767eb2b6-77cf-4042-af5f-5b6164284c4f" released by "delete_snapshot" :: held 1.751s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:23 devstack sudo[108787]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151" returned: 0 in 0.290s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Created reservations ['6f3b126f-46aa-4433-a37b-94213ffc8906', '5132bb40-58d5-4357-9989-9a861ac72ff1', '27b94b4a-ce13-40fa-a4cf-ce452603ed49', '90e6612f-16ca-4729-a3b4-346c0f3a49e6'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:23 devstack sudo[108794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.info Sep 29 18:59:23 devstack sudo[108794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:23 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Delete snapshot completed successfully. Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2489e627-90c2-4de8-8936-6f6b379407cc tempest-ProjectMemberTests-1585924540 None] Lock "cinder-18ef6bc1-a520-47b0-b9ad-bf30b3a2bcc4-delete_snapshot" released by "delete_snapshot" :: held 1.946s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:23 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9" returned: 0 in 0.437s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:24 devstack sudo[108799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9 Sep 29 18:59:24 devstack sudo[108799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:24 devstack sudo[108794]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-767eb2b6-77cf-4042-af5f-5b6164284c4f-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.info" returned: 0 in 0.309s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:24 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.info is being set with open permissions: ugo+rw Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-767eb2b6-77cf-4042-af5f-5b6164284c4f-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:24 devstack sudo[108802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.info Sep 29 18:59:24 devstack sudo[108802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-767eb2b6-77cf-4042-af5f-5b6164284c4f" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-767eb2b6-77cf-4042-af5f-5b6164284c4f" acquired by "delete_volume" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:24 devstack sudo[108799]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-39f95bf2-e578-4170-a434-b46c1cd3eca9" returned: 0 in 0.308s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-quobyte-39f95bf2-e578-4170-a434-b46c1cd3eca9" released by "delete_volume" :: held 0.805s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[568b97a2-5538-4f9a-93ff-9c9dd6baafda]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Created reservations ['a01b9b6b-decd-4d5f-8a6d-88e8986f76bb', '68687624-8c97-4fdf-ab1b-35b207a814bf', '0612670d-5243-42ed-bfe9-c321cd36ede1', 'd7d628cf-fd7b-445f-9bd4-3800fe9f077e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:24 devstack sudo[108805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f Sep 29 18:59:24 devstack sudo[108805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:24 devstack sudo[108802]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.info" returned: 0 in 0.346s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:24 devstack sudo[108808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:24 devstack sudo[108808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.372s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:24 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3ddc6a67-b236-41c5-bc12-34df94a3c681 tempest-ProjectReaderTests-1845436779 None] Create snapshot completed successfully Sep 29 18:59:24 devstack sudo[108805]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f" returned: 0 in 0.416s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:24 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f Sep 29 18:59:24 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:24 devstack sudo[108808]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.313s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:24 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Deleted volume successfully. Sep 29 18:59:24 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-515935cd-2315-40f4-8f12-09bf9d3f7567 tempest-SnapshotDependencyTests-754721868 None] Lock "cinder-39f95bf2-e578-4170-a434-b46c1cd3eca9-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:25 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-767eb2b6-77cf-4042-af5f-5b6164284c4f" returned: 0 in 0.273s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-767eb2b6-77cf-4042-af5f-5b6164284c4f" released by "delete_volume" :: held 0.771s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Created reservations ['5671d343-53b3-4249-ae4f-0747fb1a1f4e', 'dc39d9fa-6935-4cf7-88f6-59b6a8c709c4', '41221499-61ae-4d74-a12f-5d4e52e61731', 'dc3b029e-a66d-4723-873e-90eecdc2ca75'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:25 devstack sudo[108817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:25 devstack sudo[108817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-5933e93a-6c2e-4806-9b01-87d679476151-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-5933e93a-6c2e-4806-9b01-87d679476151-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-3a33430f-594d-4539-a910-fd883f25f18f" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-3a33430f-594d-4539-a910-fd883f25f18f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-5933e93a-6c2e-4806-9b01-87d679476151" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-5933e93a-6c2e-4806-9b01-87d679476151" acquired by "_delete_snapshot" :: waited 0.051s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Deleting offline snapshot 5933e93a-6c2e-4806-9b01-87d679476151 of volume 3a33430f-594d-4539-a910-fd883f25f18f {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] snapshot_file for this snap is: volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:59:25 devstack sudo[108817]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e7c0c5e-81b7-43f5-b2de-e9b918efe692]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.410s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:25 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Deleted volume successfully. Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-ab9835b5-e82c-49d8-a86f-73382e068e62 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-767eb2b6-77cf-4042-af5f-5b6164284c4f-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:25 devstack sudo[108820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 Sep 29 18:59:25 devstack sudo[108820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:25 devstack sudo[108820]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151" returned: 0 in 0.439s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:25 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a33430f-594d-4539-a910-fd883f25f18f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1ac22c-49ab-4ba9-80a9-10e06e6860cc]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (d287a5ad-a49e-488d-97d3-faae352a1ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5063fca9-0dba-40e2-980e-a5e95398f1a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5063fca9-0dba-40e2-980e-a5e95398f1a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1395536186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56542d83-47a0-4928-b8db-668e6ff6b12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:26Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed90956-10e5-4547-8078-e51c2aebf272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ed90956-10e5-4547-8078-e51c2aebf272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be06d423-58c0-4d87-a1db-9f971756abe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be06d423-58c0-4d87-a1db-9f971756abe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56542d83-47a0-4928-b8db-668e6ff6b12d', 'volume_name': 'volume-56542d83-47a0-4928-b8db-668e6ff6b12d', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3911685-eea2-452c-9338-3a42bbb2f963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3911685-eea2-452c-9338-3a42bbb2f963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2b47c5-2213-4eeb-b320-27337cf8dd73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:26 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Volume 56542d83-47a0-4928-b8db-668e6ff6b12d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56542d83-47a0-4928-b8db-668e6ff6b12d', 'volume_size': 1} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1395536186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56542d83-47a0-4928-b8db-668e6ff6b12d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:26Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Creating volume 56542d83-47a0-4928-b8db-668e6ff6b12d {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:59:26 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:26 devstack sudo[108826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d 1073741824 Sep 29 18:59:26 devstack sudo[108826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:26 devstack sudo[108825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f Sep 29 18:59:26 devstack sudo[108825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:26 devstack sudo[108825]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f" returned: 0 in 0.428s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:26 devstack sudo[108838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 Sep 29 18:59:26 devstack sudo[108838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:26 devstack sudo[108826]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d 1073741824" returned: 0 in 0.497s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:26 devstack sudo[108840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d Sep 29 18:59:26 devstack sudo[108840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:26 devstack sudo[108838]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151" returned: 0 in 0.407s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:26 devstack sudo[108846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151 Sep 29 18:59:26 devstack sudo[108846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:26 devstack sudo[108840]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d" returned: 0 in 0.310s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:26 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2b47c5-2213-4eeb-b320-27337cf8dd73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56542d83-47a0-4928-b8db-668e6ff6b12d', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6159450-c4e0-4045-a787-18e76fee7098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:27 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Volume volume-56542d83-47a0-4928-b8db-668e6ff6b12d (56542d83-47a0-4928-b8db-668e6ff6b12d): created successfully Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6159450-c4e0-4045-a787-18e76fee7098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (d287a5ad-a49e-488d-97d3-faae352a1ac2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-ccff8fce-3ec1-436c-b4ad-f2242d0acde0 tempest-ProjectMemberTests-1585924540 None] Created volume successfully. Sep 29 18:59:27 devstack sudo[108846]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f.5933e93a-6c2e-4806-9b01-87d679476151" returned: 0 in 0.291s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-5933e93a-6c2e-4806-9b01-87d679476151" released by "_delete_snapshot" :: held 1.746s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-3a33430f-594d-4539-a910-fd883f25f18f" released by "delete_snapshot" :: held 1.806s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Created reservations ['fee59a05-0646-4dab-83f6-380d63abb5fb', '85d86d11-cf1c-41fb-a8f8-7eeec58fd62c', '9986c2e1-68c9-432b-b087-b93e6d6de4b3', 'e92834aa-b622-4bbe-8acb-245e9f56527b'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:27 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Delete snapshot completed successfully. Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-56ea8996-0971-4c45-9d48-74b08d7ca236 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-5933e93a-6c2e-4806-9b01-87d679476151-delete_snapshot" released by "delete_snapshot" :: held 1.971s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-3a33430f-594d-4539-a910-fd883f25f18f-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-3a33430f-594d-4539-a910-fd883f25f18f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-3a33430f-594d-4539-a910-fd883f25f18f" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-3a33430f-594d-4539-a910-fd883f25f18f" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[d59ec9cd-b4ab-4f1f-beeb-92a8091199f9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:27 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:27 devstack sudo[108850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f Sep 29 18:59:27 devstack sudo[108850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:28 devstack sudo[108850]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f" returned: 0 in 0.384s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:28 devstack sudo[108855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f Sep 29 18:59:28 devstack sudo[108855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] Creating offline snapshot 525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 of volume 56542d83-47a0-4928-b8db-668e6ff6b12d {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[23ee4aee-e9ea-48cd-8e21-1f39a41b59a4]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:28 devstack sudo[108855]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-3a33430f-594d-4539-a910-fd883f25f18f" returned: 0 in 0.263s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-3a33430f-594d-4539-a910-fd883f25f18f" released by "delete_volume" :: held 0.707s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Created reservations ['49373ba2-242c-47e6-a85e-7e1157c1ba3f', '1fb022cf-1908-453c-a568-a944b6c4b585', '74c11544-f876-4d7d-a5de-8436cf0321d7', '61944e7b-6526-4622-959e-bd735eba59bc'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:28 devstack sudo[108858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d Sep 29 18:59:28 devstack sudo[108858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:28 devstack sudo[108860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:28 devstack sudo[108860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:28 devstack sudo[108858]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d" returned: 0 in 0.487s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:28 devstack sudo[108866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 1G Sep 29 18:59:28 devstack sudo[108866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:28 devstack sudo[108860]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.329s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:28 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Deleted volume successfully. Sep 29 18:59:28 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-2a819d24-3076-420e-8b0f-b82560fe0ec2 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-3a33430f-594d-4539-a910-fd883f25f18f-delete_volume" released by "delete_volume" :: held 1.385s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Flow 'volume_create_manager' (3ec2a1ad-6afb-4223-9f0b-5f6656a053c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6cd8da-178a-4e80-9101-e5fab3ac9354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:29 devstack sudo[108866]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6cd8da-178a-4e80-9101-e5fab3ac9354) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1287488004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25715609-80ac-4dc1-9171-02a3036e8ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834c815971d4470ba59f47c1aa514019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:29Z,use_quota=True,user_id='c5103c488a7144adb6c424a8ea928b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e8799c-2dbb-4e3a-ba96-f6afa3f26979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74e8799c-2dbb-4e3a-ba96-f6afa3f26979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752de986-7cb6-49e8-bdfb-2bf7dcced993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (752de986-7cb6-49e8-bdfb-2bf7dcced993) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25715609-80ac-4dc1-9171-02a3036e8ddf', 'volume_name': 'volume-25715609-80ac-4dc1-9171-02a3036e8ddf', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f87d17-f988-4f80-9878-cb5aa92f52bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9f87d17-f988-4f80-9878-cb5aa92f52bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd2911e-0c14-4d94-8dba-ad4497320550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:29 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Volume 25715609-80ac-4dc1-9171-02a3036e8ddf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25715609-80ac-4dc1-9171-02a3036e8ddf', 'volume_size': 1} Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 1G" returned: 0 in 0.604s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56542d83-47a0-4928-b8db-668e6ff6b12d -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:29 devstack sudo[108873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56542d83-47a0-4928-b8db-668e6ff6b12d -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 Sep 29 18:59:29 devstack sudo[108873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:29 devstack sudo[108873]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56542d83-47a0-4928-b8db-668e6ff6b12d -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4" returned: 0 in 0.364s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:29 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 is being set with open permissions: ugo+rw Sep 29 18:59:29 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:29 devstack sudo[108879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 Sep 29 18:59:29 devstack sudo[108879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:30 devstack sudo[108879]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4" returned: 0 in 0.293s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:30 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.info Sep 29 18:59:30 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:30 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.info" returned: 0 in 0.287s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:30 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.info is being set with open permissions: ugo+rw Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:30 devstack sudo[108885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.info Sep 29 18:59:30 devstack sudo[108885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:30 devstack sudo[108885]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.info" returned: 0 in 0.259s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.392s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.264s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1287488004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25715609-80ac-4dc1-9171-02a3036e8ddf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834c815971d4470ba59f47c1aa514019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:29Z,use_quota=True,user_id='c5103c488a7144adb6c424a8ea928b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Creating volume 25715609-80ac-4dc1-9171-02a3036e8ddf {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:59:30 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:59:30 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:30 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf 1073741824 Sep 29 18:59:30 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:30 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-fc717fa5-4d13-416f-8e3a-efc828e716fc tempest-ProjectMemberTests-1585924540 None] Create snapshot completed successfully Sep 29 18:59:31 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf 1073741824" returned: 0 in 0.451s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:31 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf Sep 29 18:59:31 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:31 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-525f731c-c3f2-4aa6-a4c7-7a621edc8ad4-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf" returned: 0 in 0.294s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fd2911e-0c14-4d94-8dba-ad4497320550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25715609-80ac-4dc1-9171-02a3036e8ddf', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312f751e-3d60-4cba-9e08-7e160a0d3ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-525f731c-c3f2-4aa6-a4c7-7a621edc8ad4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-56542d83-47a0-4928-b8db-668e6ff6b12d" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:31 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Volume volume-25715609-80ac-4dc1-9171-02a3036e8ddf (25715609-80ac-4dc1-9171-02a3036e8ddf): created successfully Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312f751e-3d60-4cba-9e08-7e160a0d3ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Flow 'volume_create_manager' (3ec2a1ad-6afb-4223-9f0b-5f6656a053c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-56542d83-47a0-4928-b8db-668e6ff6b12d" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-525f731c-c3f2-4aa6-a4c7-7a621edc8ad4" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:31 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1750cdca-654d-4b64-9a97-489d0fd84333 tempest-ProjectReaderTests-1845436779 None] Created volume successfully. Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-525f731c-c3f2-4aa6-a4c7-7a621edc8ad4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Deleting offline snapshot 525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 of volume 56542d83-47a0-4928-b8db-668e6ff6b12d {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] snapshot_file for this snap is: volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ddc8678-9804-41d4-8302-b683ae8de831]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:31 devstack sudo[108899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 Sep 29 18:59:31 devstack sudo[108899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:31 devstack sudo[108899]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4" returned: 0 in 0.398s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56542d83-47a0-4928-b8db-668e6ff6b12d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d29da2f-b2a7-4a0d-9e81-f97e2d7abc5f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:31 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:32 devstack sudo[108904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d Sep 29 18:59:32 devstack sudo[108904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:32 devstack sudo[108904]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d" returned: 0 in 0.394s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:32 devstack sudo[108909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 Sep 29 18:59:32 devstack sudo[108909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:32 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] Creating offline snapshot 03354c54-900d-4024-b6d1-3a41c34a92ce of volume 25715609-80ac-4dc1-9171-02a3036e8ddf {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:59:32 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c7d51f-3dec-43ca-8371-c45c97ab7562]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:32 devstack sudo[108911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf Sep 29 18:59:32 devstack sudo[108911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:32 devstack sudo[108909]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4" returned: 0 in 0.343s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:32 devstack sudo[108916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4 Sep 29 18:59:32 devstack sudo[108916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:32 devstack sudo[108911]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf" returned: 0 in 0.394s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:32 devstack sudo[108916]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:32 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d.525f731c-c3f2-4aa6-a4c7-7a621edc8ad4" returned: 0 in 0.251s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:33 devstack sudo[108922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce 1G Sep 29 18:59:33 devstack sudo[108922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-525f731c-c3f2-4aa6-a4c7-7a621edc8ad4" released by "_delete_snapshot" :: held 1.512s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-56542d83-47a0-4928-b8db-668e6ff6b12d" released by "delete_snapshot" :: held 1.539s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Created reservations ['f361d427-2280-4ed8-bf0e-e681829706fc', '287b4523-7635-4f9e-9afd-0d65d5516a02', '4c722bb4-4df8-4c9b-8082-44c47eebe109', 'dc54c074-f292-4922-af46-a14172a01e2e'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:33 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Delete snapshot completed successfully. Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-f412220b-fea9-4f20-8a2d-a8ca96e7e779 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-525f731c-c3f2-4aa6-a4c7-7a621edc8ad4-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:33 devstack sudo[108922]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce 1G" returned: 0 in 0.552s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25715609-80ac-4dc1-9171-02a3036e8ddf -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:33 devstack sudo[108927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25715609-80ac-4dc1-9171-02a3036e8ddf -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce Sep 29 18:59:33 devstack sudo[108927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-56542d83-47a0-4928-b8db-668e6ff6b12d-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Lock "cinder-56542d83-47a0-4928-b8db-668e6ff6b12d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-56542d83-47a0-4928-b8db-668e6ff6b12d" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-56542d83-47a0-4928-b8db-668e6ff6b12d" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdc3a82-c2f6-4153-9af3-becd169a7340]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:33 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d Sep 29 18:59:33 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:33 devstack sudo[108927]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-25715609-80ac-4dc1-9171-02a3036e8ddf -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce" returned: 0 in 0.374s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:33 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce is being set with open permissions: ugo+rw Sep 29 18:59:33 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:33 devstack sudo[108935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce Sep 29 18:59:33 devstack sudo[108935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:34 devstack sudo[108935]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:34 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce" returned: 0 in 0.347s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d" returned: 0 in 0.505s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:34 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d Sep 29 18:59:34 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:34 devstack sudo[108946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.info Sep 29 18:59:34 devstack sudo[108946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:34 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-56542d83-47a0-4928-b8db-668e6ff6b12d" returned: 0 in 0.266s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-56542d83-47a0-4928-b8db-668e6ff6b12d" released by "delete_volume" :: held 0.865s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Created reservations ['3bfbf285-ae95-4529-8fa0-cc92c01e5114', '32b947b0-3497-4fd0-bad2-ebebdc5a6bd3', '35fedc5e-5d9d-42fc-a539-239282d4daa4', 'de05b76a-2826-4285-9369-263af0b332ba'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:34 devstack sudo[108946]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.info" returned: 0 in 0.345s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:34 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.info is being set with open permissions: ugo+rw Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:34 devstack sudo[108950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.info Sep 29 18:59:34 devstack sudo[108950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:34 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:34 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:34 devstack sudo[108950]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.info" returned: 0 in 0.301s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.439s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:34 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.272s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:34 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:35 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Deleted volume successfully. Sep 29 18:59:35 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3cfbff29-a46b-4f87-a8d2-ed8eb2b5ef58 tempest-ProjectReaderTests-1845436779 None] Create snapshot completed successfully Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a3dd84e5-5907-4572-8d0f-55a89730991f tempest-ProjectMemberTests-1585924540 None] Lock "cinder-56542d83-47a0-4928-b8db-668e6ff6b12d-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (00e475cc-d193-4e5e-abfb-17aa842a7883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9183ae89-2304-433c-ac48-96837281f4a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9183ae89-2304-433c-ac48-96837281f4a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-538559357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed36fd2-368f-492f-adce-91af87103987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:36Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbb428e-dc0f-475a-93a9-2c6e19efdedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffbb428e-dc0f-475a-93a9-2c6e19efdedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcaf92f-2354-4af3-b7d9-92f61e812eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebcaf92f-2354-4af3-b7d9-92f61e812eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed36fd2-368f-492f-adce-91af87103987', 'volume_name': 'volume-eed36fd2-368f-492f-adce-91af87103987', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c16b475-191b-45ba-b6e3-570615f09c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c16b475-191b-45ba-b6e3-570615f09c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63578e56-68e9-492d-9ec6-857e5dd96c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:35 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Volume eed36fd2-368f-492f-adce-91af87103987: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed36fd2-368f-492f-adce-91af87103987', 'volume_size': 1} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-538559357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed36fd2-368f-492f-adce-91af87103987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:36Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Creating volume eed36fd2-368f-492f-adce-91af87103987 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:59:35 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-03354c54-900d-4024-b6d1-3a41c34a92ce-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:35 devstack sudo[108956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987 1073741824 Sep 29 18:59:35 devstack sudo[108956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-03354c54-900d-4024-b6d1-3a41c34a92ce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-25715609-80ac-4dc1-9171-02a3036e8ddf" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-25715609-80ac-4dc1-9171-02a3036e8ddf" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-03354c54-900d-4024-b6d1-3a41c34a92ce" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-03354c54-900d-4024-b6d1-3a41c34a92ce" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Deleting offline snapshot 03354c54-900d-4024-b6d1-3a41c34a92ce of volume 25715609-80ac-4dc1-9171-02a3036e8ddf {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] snapshot_file for this snap is: volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5178322b-391c-4642-b20c-378bb5f52070]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:35 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:35 devstack sudo[108958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce Sep 29 18:59:35 devstack sudo[108958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:36 devstack sudo[108956]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987 1073741824" returned: 0 in 0.523s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:36 devstack sudo[108958]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:36 devstack sudo[108969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987 Sep 29 18:59:36 devstack sudo[108969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce" returned: 0 in 0.479s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25715609-80ac-4dc1-9171-02a3036e8ddf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[813ac008-7f2b-42ef-9071-ac423a5306c9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:36 devstack sudo[108971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf Sep 29 18:59:36 devstack sudo[108971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:36 devstack sudo[108969]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987" returned: 0 in 0.295s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63578e56-68e9-492d-9ec6-857e5dd96c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed36fd2-368f-492f-adce-91af87103987', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3028ff1a-f249-429e-91cb-511581588cb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:36 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Volume volume-eed36fd2-368f-492f-adce-91af87103987 (eed36fd2-368f-492f-adce-91af87103987): created successfully Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3028ff1a-f249-429e-91cb-511581588cb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (00e475cc-d193-4e5e-abfb-17aa842a7883) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:36 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8811879f-44e5-4ecf-942c-e4d82d21ce8d tempest-ProjectMemberTests-1585924540 None] Created volume successfully. Sep 29 18:59:36 devstack sudo[108971]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf" returned: 0 in 0.398s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:36 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:36 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce Sep 29 18:59:36 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:37 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce" returned: 0 in 0.333s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:37 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce Sep 29 18:59:37 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:37 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf.03354c54-900d-4024-b6d1-3a41c34a92ce" returned: 0 in 0.246s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-03354c54-900d-4024-b6d1-3a41c34a92ce" released by "_delete_snapshot" :: held 1.585s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-25715609-80ac-4dc1-9171-02a3036e8ddf" released by "delete_snapshot" :: held 1.608s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Created reservations ['ec13a6b4-f12d-40ab-b9e0-a8ef5164d6d6', 'dfae3c6c-e11b-4957-8595-e545521383e1', 'd059f2e2-01b7-43ba-b59d-acc6eda9a9b6', 'aab08cf8-6457-4594-82b3-627d2c849e54'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:37 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Delete snapshot completed successfully. Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-a97bd91e-1c1e-4eee-b91c-8008d94be407 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-03354c54-900d-4024-b6d1-3a41c34a92ce-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:DELETE=18,cinder:UPDATE=229,cinder:SELECT=183,cinder:INSERT=56 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] Creating offline snapshot cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab of volume eed36fd2-368f-492f-adce-91af87103987 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-25715609-80ac-4dc1-9171-02a3036e8ddf-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b3a41c-409f-48c4-bf9b-53db7f33eb33]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:37 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-25715609-80ac-4dc1-9171-02a3036e8ddf-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-25715609-80ac-4dc1-9171-02a3036e8ddf" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-25715609-80ac-4dc1-9171-02a3036e8ddf" acquired by "delete_volume" :: waited 0.014s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:38 devstack sudo[108985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987 Sep 29 18:59:38 devstack sudo[108985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[72244c37-8649-4abf-9ba1-90c7e1354648]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:38 devstack sudo[108987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf Sep 29 18:59:38 devstack sudo[108987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:38 devstack sudo[108985]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987" returned: 0 in 0.391s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:38 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab 1G Sep 29 18:59:38 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:38 devstack sudo[108987]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf" returned: 0 in 0.410s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:38 devstack sudo[108997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf Sep 29 18:59:38 devstack sudo[108997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:38 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab 1G" returned: 0 in 0.400s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed36fd2-368f-492f-adce-91af87103987 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:38 devstack sudo[109002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed36fd2-368f-492f-adce-91af87103987 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab Sep 29 18:59:38 devstack sudo[109002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:38 devstack sudo[108997]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-25715609-80ac-4dc1-9171-02a3036e8ddf" returned: 0 in 0.279s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-25715609-80ac-4dc1-9171-02a3036e8ddf" released by "delete_volume" :: held 0.758s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=167,cinder:UPDATE=234,cinder:INSERT=64,cinder:DELETE=23 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Created reservations ['9cd9abc3-031d-49ac-bc93-68c4988f07b7', 'bf6b70d6-8f0e-4d47-ab5c-ac5afc36b0c2', '1a06a4fa-a046-461f-a9bf-f9c618658541', '588fc39c-ab1f-45f8-81d7-99dc22fcc613'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:38 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:38 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:38 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:39 devstack sudo[109002]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eed36fd2-368f-492f-adce-91af87103987 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab" returned: 0 in 0.347s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:39 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab is being set with open permissions: ugo+rw Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:39 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab Sep 29 18:59:39 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:39 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.273s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:39 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Deleted volume successfully. Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-c919f775-6fb9-424b-9efc-177276425296 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-25715609-80ac-4dc1-9171-02a3036e8ddf-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:39 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab" returned: 0 in 0.297s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:39 devstack sudo[109015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.info Sep 29 18:59:39 devstack sudo[109015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Flow 'volume_create_manager' (558c06eb-a9fc-4173-952f-54b79b7bc03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0024d86d-7380-4247-b191-25053f0769c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0024d86d-7380-4247-b191-25053f0769c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1605794843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c535612-c356-4807-899e-7734c7b0f546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834c815971d4470ba59f47c1aa514019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:40Z,use_quota=True,user_id='c5103c488a7144adb6c424a8ea928b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6b66b8-9c96-427e-a0fd-2fd54ca37b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e6b66b8-9c96-427e-a0fd-2fd54ca37b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5089165f-695a-43f2-9eb1-eb68db90cb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5089165f-695a-43f2-9eb1-eb68db90cb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c535612-c356-4807-899e-7734c7b0f546', 'volume_name': 'volume-5c535612-c356-4807-899e-7734c7b0f546', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896fc02c-8833-4376-a3bd-80307378fb6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (896fc02c-8833-4376-a3bd-80307378fb6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ea6f0d-cddb-47c5-b769-83f95a5f79d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:39 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Volume 5c535612-c356-4807-899e-7734c7b0f546: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c535612-c356-4807-899e-7734c7b0f546', 'volume_size': 1} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:39 devstack sudo[109015]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.info" returned: 0 in 0.274s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:39 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.info is being set with open permissions: ugo+rw Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:39 devstack sudo[109018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.info Sep 29 18:59:39 devstack sudo[109018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:39 devstack sudo[109018]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.info" returned: 0 in 0.253s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.319s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1605794843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c535612-c356-4807-899e-7734c7b0f546,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834c815971d4470ba59f47c1aa514019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:40Z,use_quota=True,user_id='c5103c488a7144adb6c424a8ea928b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Creating volume 5c535612-c356-4807-899e-7734c7b0f546 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:59:39 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:59:39 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:40 devstack sudo[109021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546 1073741824 Sep 29 18:59:40 devstack sudo[109021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:40 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-92b5ac21-d381-4a9f-8abc-5ddb3abc4b79 tempest-ProjectMemberTests-1585924540 None] Create snapshot completed successfully Sep 29 18:59:40 devstack sudo[109021]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546 1073741824" returned: 0 in 0.422s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:40 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546 Sep 29 18:59:40 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:40 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546" returned: 0 in 0.242s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:40 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:59:40 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3ea6f0d-cddb-47c5-b769-83f95a5f79d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c535612-c356-4807-899e-7734c7b0f546', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9f3100-9459-40fe-aca9-3e1308ec9493) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:40 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Volume volume-5c535612-c356-4807-899e-7734c7b0f546 (5c535612-c356-4807-899e-7734c7b0f546): created successfully Sep 29 18:59:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d9f3100-9459-40fe-aca9-3e1308ec9493) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:40 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Flow 'volume_create_manager' (558c06eb-a9fc-4173-952f-54b79b7bc03d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:40 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-394c7537-2142-402e-8011-300269af5349 tempest-ProjectReaderTests-1845436779 None] Created volume successfully. Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-eed36fd2-368f-492f-adce-91af87103987" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-eed36fd2-368f-492f-adce-91af87103987" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Deleting offline snapshot cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab of volume eed36fd2-368f-492f-adce-91af87103987 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] snapshot_file for this snap is: volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0d3ca7-eb57-40ce-9f0f-37eff3f8b369]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:41 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab Sep 29 18:59:41 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:41 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab" returned: 0 in 0.356s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eed36fd2-368f-492f-adce-91af87103987(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f332df-a7f6-437b-897d-045d4294bb9f]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:41 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987 Sep 29 18:59:41 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] Creating offline snapshot 8c42e554-45c0-4103-8fe4-816574d2e6eb of volume 5c535612-c356-4807-899e-7734c7b0f546 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fdd3cfc-5e1d-4f8b-85cf-18ee669fb008]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:41 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987" returned: 0 in 0.387s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:41 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:41 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab Sep 29 18:59:41 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:41 devstack sudo[109038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546 Sep 29 18:59:41 devstack sudo[109038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:42 devstack sudo[109038]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546" returned: 0 in 0.375s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:42 devstack sudo[109050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb 1G Sep 29 18:59:42 devstack sudo[109050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:42 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab" returned: 0 in 0.357s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:42 devstack sudo[109052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab Sep 29 18:59:42 devstack sudo[109052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:42 devstack sudo[109052]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987.cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab" returned: 0 in 0.263s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab" released by "_delete_snapshot" :: held 1.464s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-eed36fd2-368f-492f-adce-91af87103987" released by "delete_snapshot" :: held 1.486s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:42 devstack sudo[109050]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb 1G" returned: 0 in 0.405s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c535612-c356-4807-899e-7734c7b0f546 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:42 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Created reservations ['01753262-7b61-438b-af56-503295585dba', '0196a816-2c5a-4d2c-850a-ca8f997eaa3f', '95dec535-95fb-4eab-99f4-d2dcaf188343', '20d6eae9-fcfc-4eda-a6df-46e661d45505'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:42 devstack sudo[109059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c535612-c356-4807-899e-7734c7b0f546 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb Sep 29 18:59:42 devstack sudo[109059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:42 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Delete snapshot completed successfully. Sep 29 18:59:42 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-391bd255-8b5a-4ff7-90a6-7d073b1f5b10 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-cdb8a1f8-c0e0-4d7c-895c-565ab69d42ab-delete_snapshot" released by "delete_snapshot" :: held 1.640s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:42 devstack sudo[109059]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c535612-c356-4807-899e-7734c7b0f546 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb" returned: 0 in 0.298s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:42 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb is being set with open permissions: ugo+rw Sep 29 18:59:42 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:42 devstack sudo[109064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb Sep 29 18:59:42 devstack sudo[109064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:43 devstack sudo[109064]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb" returned: 0 in 0.267s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-eed36fd2-368f-492f-adce-91af87103987-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Lock "cinder-eed36fd2-368f-492f-adce-91af87103987-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:43 devstack sudo[109067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.info Sep 29 18:59:43 devstack sudo[109067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-eed36fd2-368f-492f-adce-91af87103987" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-eed36fd2-368f-492f-adce-91af87103987" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dedf8b-2596-4476-945c-7bea298183d6]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:43 devstack sudo[109069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987 Sep 29 18:59:43 devstack sudo[109069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:43 devstack sudo[109067]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.info" returned: 0 in 0.277s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:43 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.info is being set with open permissions: ugo+rw Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:43 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.info Sep 29 18:59:43 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:43 devstack sudo[109069]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987" returned: 0 in 0.370s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:43 devstack sudo[109079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987 Sep 29 18:59:43 devstack sudo[109079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:43 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.info" returned: 0 in 0.252s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:43 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-7733a785-c096-40b3-b591-82ed2323a480 tempest-ProjectReaderTests-1845436779 None] Create snapshot completed successfully Sep 29 18:59:43 devstack sudo[109079]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:43 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-eed36fd2-368f-492f-adce-91af87103987" returned: 0 in 0.257s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-eed36fd2-368f-492f-adce-91af87103987" released by "delete_volume" :: held 0.685s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Created reservations ['8dd73d25-e94a-4823-a2db-88a987a72ec1', '3de13fe6-0643-43c8-aaab-6c027c3194bf', 'ef31267e-faf6-4ff1-99cb-c1a77f3a7f53', '89d4dcdb-8811-4c77-b539-39de7aa36107'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:44 devstack sudo[109082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:44 devstack sudo[109082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:44 devstack sudo[109082]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.265s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:44 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Deleted volume successfully. Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-d1f0e567-6b3e-4e72-abe9-3945af31835b tempest-ProjectMemberTests-1585924540 None] Lock "cinder-eed36fd2-368f-492f-adce-91af87103987-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (cb172d68-ead7-4807-98b8-5633656eb3f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07791ee6-25f6-4e31-b304-a5fed464b44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07791ee6-25f6-4e31-b304-a5fed464b44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801466988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed732ca-6033-4839-8261-e08aab732da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:45Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b73b4cb-2940-4705-8ae5-b75b32304dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b73b4cb-2940-4705-8ae5-b75b32304dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899d6bed-2421-41f5-bc2a-879bd1fc7530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (899d6bed-2421-41f5-bc2a-879bd1fc7530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aed732ca-6033-4839-8261-e08aab732da5', 'volume_name': 'volume-aed732ca-6033-4839-8261-e08aab732da5', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32f8617-9d0a-43a6-a73e-c4c50b7da892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b32f8617-9d0a-43a6-a73e-c4c50b7da892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da21023-4851-4627-ac09-cc89ce0c0b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:44 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Volume aed732ca-6033-4839-8261-e08aab732da5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aed732ca-6033-4839-8261-e08aab732da5', 'volume_size': 1} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1801466988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aed732ca-6033-4839-8261-e08aab732da5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:45Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Creating volume aed732ca-6033-4839-8261-e08aab732da5 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:59:44 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:44 devstack sudo[109085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5 1073741824 Sep 29 18:59:44 devstack sudo[109085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-8c42e554-45c0-4103-8fe4-816574d2e6eb-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-8c42e554-45c0-4103-8fe4-816574d2e6eb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:44 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-5c535612-c356-4807-899e-7734c7b0f546" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-5c535612-c356-4807-899e-7734c7b0f546" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-8c42e554-45c0-4103-8fe4-816574d2e6eb" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-8c42e554-45c0-4103-8fe4-816574d2e6eb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Deleting offline snapshot 8c42e554-45c0-4103-8fe4-816574d2e6eb of volume 5c535612-c356-4807-899e-7734c7b0f546 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] snapshot_file for this snap is: volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b8147f-2096-4467-a791-661305586e1d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:45 devstack sudo[109087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb Sep 29 18:59:45 devstack sudo[109087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:45 devstack sudo[109085]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5 1073741824" returned: 0 in 0.452s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:45 devstack sudo[109093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5 Sep 29 18:59:45 devstack sudo[109093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:45 devstack sudo[109087]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb" returned: 0 in 0.417s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c535612-c356-4807-899e-7734c7b0f546(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddce69bc-2a0e-482f-8347-ed1ea6c0a73d]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:45 devstack sudo[109098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546 Sep 29 18:59:45 devstack sudo[109098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:45 devstack sudo[109093]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5" returned: 0 in 0.273s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6da21023-4851-4627-ac09-cc89ce0c0b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aed732ca-6033-4839-8261-e08aab732da5', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65227dfb-6306-4050-8be2-f0b0aab1a00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:45 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Volume volume-aed732ca-6033-4839-8261-e08aab732da5 (aed732ca-6033-4839-8261-e08aab732da5): created successfully Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65227dfb-6306-4050-8be2-f0b0aab1a00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (cb172d68-ead7-4807-98b8-5633656eb3f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:45 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d57a04dd-7dc5-42de-9e7b-b900aecee627 tempest-ProjectMemberTests-1585924540 None] Created volume successfully. Sep 29 18:59:45 devstack sudo[109098]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546" returned: 0 in 0.383s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:45 devstack sudo[109104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb Sep 29 18:59:45 devstack sudo[109104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:45 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] Creating offline snapshot d1441bfe-6d10-4886-9335-468a5b390bf3 of volume aed732ca-6033-4839-8261-e08aab732da5 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34f775e-c711-46fb-a2f6-8fb3671e12be]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:46 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5 Sep 29 18:59:46 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:46 devstack sudo[109104]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb" returned: 0 in 0.372s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:46 devstack sudo[109111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb Sep 29 18:59:46 devstack sudo[109111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:46 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5" returned: 0 in 0.382s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:46 devstack sudo[109116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 1G Sep 29 18:59:46 devstack sudo[109116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:46 devstack sudo[109111]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546.8c42e554-45c0-4103-8fe4-816574d2e6eb" returned: 0 in 0.256s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-8c42e554-45c0-4103-8fe4-816574d2e6eb" released by "_delete_snapshot" :: held 1.553s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-5c535612-c356-4807-899e-7734c7b0f546" released by "delete_snapshot" :: held 1.577s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Created reservations ['a9357dd7-f805-4b48-b840-5ae996c60103', '2e7cb4bd-dc66-4bcf-8d54-7762ddcbd3ce', 'b3a91960-5f02-4d79-8d45-986cdd857f09', '055b1efb-d479-41b8-9f73-6f0348580998'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:46 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Delete snapshot completed successfully. Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-97a25712-cb40-4987-8e90-e5ce8d417957 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-8c42e554-45c0-4103-8fe4-816574d2e6eb-delete_snapshot" released by "delete_snapshot" :: held 1.715s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:46 devstack sudo[109116]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 1G" returned: 0 in 0.415s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:46 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed732ca-6033-4839-8261-e08aab732da5 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:46 devstack sudo[109122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed732ca-6033-4839-8261-e08aab732da5 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 Sep 29 18:59:46 devstack sudo[109122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-5c535612-c356-4807-899e-7734c7b0f546-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:47 devstack sudo[109122]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aed732ca-6033-4839-8261-e08aab732da5 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3" returned: 0 in 0.314s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:47 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 is being set with open permissions: ugo+rw Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-5c535612-c356-4807-899e-7734c7b0f546-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:47 devstack sudo[109127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 Sep 29 18:59:47 devstack sudo[109127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-5c535612-c356-4807-899e-7734c7b0f546" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-5c535612-c356-4807-899e-7734c7b0f546" acquired by "delete_volume" :: waited 0.018s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e97d50b-ed36-47dd-9e38-3fb3d41e3a65]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:47 devstack sudo[109129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546 Sep 29 18:59:47 devstack sudo[109129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:47 devstack sudo[109127]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3" returned: 0 in 0.292s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:47 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.info Sep 29 18:59:47 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:47 devstack sudo[109129]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546" returned: 0 in 0.379s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:47 devstack sudo[109137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546 Sep 29 18:59:47 devstack sudo[109137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:47 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.info" returned: 0 in 0.268s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:47 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.info is being set with open permissions: ugo+rw Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:47 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.info Sep 29 18:59:47 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:47 devstack sudo[109137]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-5c535612-c356-4807-899e-7734c7b0f546" returned: 0 in 0.255s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:47 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-5c535612-c356-4807-899e-7734c7b0f546" released by "delete_volume" :: held 0.706s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Created reservations ['b582bf1b-ea5e-4aa0-983b-2aba25807cf6', '9c3d0ee9-8b98-4949-b3f8-d41b694f6432', '9c1a07b8-d0a5-4db1-8747-fe6eb9fdbbc7', 'eb070dc9-ec91-47d9-9c79-f1e80c1f52ef'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:48 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.info" returned: 0 in 0.270s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.051s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:48 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8f402f3f-1be7-4d94-b98c-462c2f6aebd1 tempest-ProjectMemberTests-1585924540 None] Create snapshot completed successfully Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:48 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:48 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:48 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.254s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:48 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Deleted volume successfully. Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-da1beda1-3286-420d-a7f9-12a5dbb122e1 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-5c535612-c356-4807-899e-7734c7b0f546-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Flow 'volume_create_manager' (4a043e5e-e886-4b3f-bc09-1d95fafc3e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10dc96fa-4c59-4bc4-ab32-c617cb8cf70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10dc96fa-4c59-4bc4-ab32-c617cb8cf70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649570471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6042f6f-a5ed-46c0-b099-6a7514f2bbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834c815971d4470ba59f47c1aa514019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:49Z,use_quota=True,user_id='c5103c488a7144adb6c424a8ea928b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db5f6e7-d725-47af-ae62-91c43114c932) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4db5f6e7-d725-47af-ae62-91c43114c932) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecf3cf1-08a6-4873-afb4-4f6e411d3fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aecf3cf1-08a6-4873-afb4-4f6e411d3fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6042f6f-a5ed-46c0-b099-6a7514f2bbc4', 'volume_name': 'volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552a1b22-16d1-4c42-9f8b-c21295401d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (552a1b22-16d1-4c42-9f8b-c21295401d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a9bfd5-70d5-422a-ab64-c169479a3ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:48 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Volume b6042f6f-a5ed-46c0-b099-6a7514f2bbc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4', 'volume_size': 1} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-649570471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6042f6f-a5ed-46c0-b099-6a7514f2bbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='834c815971d4470ba59f47c1aa514019',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:49Z,use_quota=True,user_id='c5103c488a7144adb6c424a8ea928b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Creating volume b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:59:48 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:59:48 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:48 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 1073741824 Sep 29 18:59:48 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-d1441bfe-6d10-4886-9335-468a5b390bf3-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-d1441bfe-6d10-4886-9335-468a5b390bf3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-aed732ca-6033-4839-8261-e08aab732da5" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-aed732ca-6033-4839-8261-e08aab732da5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-d1441bfe-6d10-4886-9335-468a5b390bf3" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-d1441bfe-6d10-4886-9335-468a5b390bf3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Deleting offline snapshot d1441bfe-6d10-4886-9335-468a5b390bf3 of volume aed732ca-6033-4839-8261-e08aab732da5 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] snapshot_file for this snap is: volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[80350639-d6c7-4c19-a865-126ef14600cf]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:49 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 1073741824" returned: 0 in 0.503s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:49 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 Sep 29 18:59:49 devstack sudo[109155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 Sep 29 18:59:49 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:49 devstack sudo[109155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:49 devstack sudo[109155]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4" returned: 0 in 0.255s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a9bfd5-70d5-422a-ab64-c169479a3ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13201a9-bd72-4e0a-a03a-a5a566526113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:49 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Volume volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 (b6042f6f-a5ed-46c0-b099-6a7514f2bbc4): created successfully Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c13201a9-bd72-4e0a-a03a-a5a566526113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Flow 'volume_create_manager' (4a043e5e-e886-4b3f-bc09-1d95fafc3e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:49 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-d690faa7-78c7-49f8-bb3c-aee9bcd12893 tempest-ProjectReaderTests-1845436779 None] Created volume successfully. Sep 29 18:59:49 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3" returned: 0 in 0.437s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aed732ca-6033-4839-8261-e08aab732da5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0418be3-53f7-4836-a9bb-c6076c90db61]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:49 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:49 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5 Sep 29 18:59:49 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:50 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5" returned: 0 in 0.355s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:50 devstack sudo[109167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 Sep 29 18:59:50 devstack sudo[109167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:50 devstack sudo[109167]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3" returned: 0 in 0.330s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:50 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3 Sep 29 18:59:50 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:50 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5.d1441bfe-6d10-4886-9335-468a5b390bf3" returned: 0 in 0.240s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-d1441bfe-6d10-4886-9335-468a5b390bf3" released by "_delete_snapshot" :: held 1.461s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-aed732ca-6033-4839-8261-e08aab732da5" released by "delete_snapshot" :: held 1.489s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:50 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Created reservations ['b43255f0-a41c-4c92-bed2-7df4a84502f1', '704888f6-88ee-4f61-9add-9138e546df4b', '15190e7b-4448-4098-bb06-a03a24e4ec88', 'a68096dd-6a4f-4400-8e1e-5764952b6392'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:50 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Delete snapshot completed successfully. Sep 29 18:59:50 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-0bd7b5f4-4c00-4343-a732-0f626781b514 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-d1441bfe-6d10-4886-9335-468a5b390bf3-delete_snapshot" released by "delete_snapshot" :: held 1.653s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:50 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] Creating offline snapshot 74dad40c-8446-46e3-8a78-4729357adf01 of volume b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[19a5b35f-4f48-407b-8ad7-23798daf59b9]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:51 devstack sudo[109175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 Sep 29 18:59:51 devstack sudo[109175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-aed732ca-6033-4839-8261-e08aab732da5-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-aed732ca-6033-4839-8261-e08aab732da5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:51 devstack sudo[109175]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4" returned: 0 in 0.384s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:51 devstack sudo[109180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 1G Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-aed732ca-6033-4839-8261-e08aab732da5" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:51 devstack sudo[109180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-aed732ca-6033-4839-8261-e08aab732da5" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea630dde-6709-40e9-a92d-54bac19ff2fa]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:51 devstack sudo[109182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5 Sep 29 18:59:51 devstack sudo[109182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:51 devstack sudo[109180]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 1G" returned: 0 in 0.416s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:51 devstack sudo[109189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 Sep 29 18:59:51 devstack sudo[109189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:51 devstack sudo[109182]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5" returned: 0 in 0.392s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:51 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:51 devstack sudo[109192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5 Sep 29 18:59:51 devstack sudo[109192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:52 devstack sudo[109189]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01" returned: 0 in 0.309s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:52 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 is being set with open permissions: ugo+rw Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:52 devstack sudo[109198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 Sep 29 18:59:52 devstack sudo[109198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:52 devstack sudo[109192]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-aed732ca-6033-4839-8261-e08aab732da5" returned: 0 in 0.280s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-aed732ca-6033-4839-8261-e08aab732da5" released by "delete_volume" :: held 0.744s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Created reservations ['263006c3-5740-47a7-afff-97da8a70df2f', 'cf567487-68f4-4e7b-9c7a-caea99712064', '18563df0-f8b1-4f26-9c3b-71401303ff1e', '192f7eef-b74a-4d13-b8d5-cf2feff51e48'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:52 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:52 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:52 devstack sudo[109198]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01" returned: 0 in 0.265s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:52 devstack sudo[109203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.info Sep 29 18:59:52 devstack sudo[109203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:52 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.258s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:52 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Deleted volume successfully. Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-535becf3-56d7-4de3-98db-a99848b0fa64 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-aed732ca-6033-4839-8261-e08aab732da5-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:52 devstack sudo[109203]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.info" returned: 0 in 0.275s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:52 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.info is being set with open permissions: ugo+rw Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:52 devstack sudo[109207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.info Sep 29 18:59:52 devstack sudo[109207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:52 devstack sudo[109207]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:52 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.info" returned: 0 in 0.261s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:53 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-c751b1c4-7939-4cd1-a456-950c160b69b1 tempest-ProjectReaderTests-1845436779 None] Create snapshot completed successfully Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (a7447a44-d72d-4797-b3c7-f224b2df5bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e158a9c8-1414-4400-860d-5c7b7653cbc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e158a9c8-1414-4400-860d-5c7b7653cbc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-360189630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8eeb57-d191-4cb5-8fa2-c9c402826753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:53Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edef4c5-69a9-4ca2-bc84-169f9b79397d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7edef4c5-69a9-4ca2-bc84-169f9b79397d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3899acad-84f6-4f51-b54b-8a70c240fb61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3899acad-84f6-4f51-b54b-8a70c240fb61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af8eeb57-d191-4cb5-8fa2-c9c402826753', 'volume_name': 'volume-af8eeb57-d191-4cb5-8fa2-c9c402826753', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dcd0305-58f9-40e8-90bf-1f639efce59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5dcd0305-58f9-40e8-90bf-1f639efce59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315c569a-d0e0-4607-b038-994acfd0fe24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:53 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Volume af8eeb57-d191-4cb5-8fa2-c9c402826753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af8eeb57-d191-4cb5-8fa2-c9c402826753', 'volume_size': 1} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T16:59:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-360189630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af8eeb57-d191-4cb5-8fa2-c9c402826753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T16:59:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T16:59:53Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Creating volume af8eeb57-d191-4cb5-8fa2-c9c402826753 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 18:59:53 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:53 devstack sudo[109210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 1073741824 Sep 29 18:59:53 devstack sudo[109210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:53 devstack sudo[109210]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 1073741824" returned: 0 in 0.437s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:53 devstack sudo[109217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 Sep 29 18:59:53 devstack sudo[109217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:53 devstack sudo[109217]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753" returned: 0 in 0.261s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (315c569a-d0e0-4607-b038-994acfd0fe24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af8eeb57-d191-4cb5-8fa2-c9c402826753', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc8b5ed-0ccf-4f0e-85b8-6d4c93176c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 18:59:53 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Volume volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 (af8eeb57-d191-4cb5-8fa2-c9c402826753): created successfully Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fc8b5ed-0ccf-4f0e-85b8-6d4c93176c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 18:59:53 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (a7447a44-d72d-4797-b3c7-f224b2df5bdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 18:59:53 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6cceb225-782a-4e2b-a854-e02e78ee3d52 tempest-ProjectMemberTests-1585924540 None] Created volume successfully. Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-74dad40c-8446-46e3-8a78-4729357adf01-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-74dad40c-8446-46e3-8a78-4729357adf01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-74dad40c-8446-46e3-8a78-4729357adf01" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-74dad40c-8446-46e3-8a78-4729357adf01" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Deleting offline snapshot 74dad40c-8446-46e3-8a78-4729357adf01 of volume b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] snapshot_file for this snap is: volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] Creating offline snapshot 60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 of volume af8eeb57-d191-4cb5-8fa2-c9c402826753 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[07971606-a684-462a-a1b6-9e042a0944b8]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f55f365-e1d2-4a6b-b6e4-6093fe6677ff]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:54 devstack sudo[109220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 Sep 29 18:59:54 devstack sudo[109220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:54 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 Sep 29 18:59:54 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:54 devstack sudo[109220]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01" returned: 0 in 0.374s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:59:54 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753" returned: 0 in 0.386s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca7b40f-d152-4f12-bce9-4fc6525782fb]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:54 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:54 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 1G Sep 29 18:59:54 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:54 devstack sudo[109231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 Sep 29 18:59:54 devstack sudo[109231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:55 devstack sudo[109231]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4" returned: 0 in 0.380s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:55 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 1G" returned: 0 in 0.405s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:55 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 Sep 29 18:59:55 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:55 devstack sudo[109241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 Sep 29 18:59:55 devstack sudo[109241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:55 devstack sudo[109241]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24" returned: 0 in 0.300s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:55 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 is being set with open permissions: ugo+rw Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:55 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 Sep 29 18:59:55 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:55 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01" returned: 0 in 0.360s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:55 devstack sudo[109252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01 Sep 29 18:59:55 devstack sudo[109252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:55 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24" returned: 0 in 0.250s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:55 devstack sudo[109252]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4.74dad40c-8446-46e3-8a78-4729357adf01" returned: 0 in 0.256s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:55 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.info Sep 29 18:59:55 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-74dad40c-8446-46e3-8a78-4729357adf01" released by "_delete_snapshot" :: held 1.479s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4" released by "delete_snapshot" :: held 1.512s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Created reservations ['2dc5b82e-787d-4b9c-8d1b-7cb8f46bf0cb', '64ce0380-dde7-4411-9a7e-7260ae5b18e7', '8d06cb70-5dd1-4484-9161-2df816727142', '132d9857-7f7f-4c36-be96-25ab0991c5a5'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:55 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Delete snapshot completed successfully. Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4d78adb0-9de2-4584-a2e8-a13b5ddcc767 tempest-ProjectReaderTests-1845436779 None] Lock "cinder-74dad40c-8446-46e3-8a78-4729357adf01-delete_snapshot" released by "delete_snapshot" :: held 1.647s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:55 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.info" returned: 0 in 0.264s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:55 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.info is being set with open permissions: ugo+rw Sep 29 18:59:55 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:55 devstack sudo[109259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.info Sep 29 18:59:55 devstack sudo[109259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:56 devstack sudo[109259]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.info" returned: 0 in 0.242s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:56 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-8ae6ebe5-0b00-44c5-ac4d-0783ef8546f1 tempest-ProjectMemberTests-1585924540 None] Create snapshot completed successfully Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Lock "cinder-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-60754bf7-ab09-4c64-9e9b-fc5fec0b2b24-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Lock "cinder-60754bf7-ab09-4c64-9e9b-fc5fec0b2b24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-af8eeb57-d191-4cb5-8fa2-c9c402826753" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-af8eeb57-d191-4cb5-8fa2-c9c402826753" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-60754bf7-ab09-4c64-9e9b-fc5fec0b2b24" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Acquiring lock "cinder-quobyte-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-60754bf7-ab09-4c64-9e9b-fc5fec0b2b24" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Deleting offline snapshot 60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 of volume af8eeb57-d191-4cb5-8fa2-c9c402826753 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] snapshot_file for this snap is: volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4" acquired by "delete_volume" :: waited 0.041s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca321e2-8876-4318-a342-fbf32204c714]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f43d061-86dc-417f-a9fa-0ec4a6a47c4c]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:56 devstack sudo[109263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 Sep 29 18:59:56 devstack sudo[109263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:56 devstack sudo[109264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 Sep 29 18:59:56 devstack sudo[109264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:56 devstack sudo[109264]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4" returned: 0 in 0.360s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:56 devstack sudo[109263]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24" returned: 0 in 0.403s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af8eeb57-d191-4cb5-8fa2-c9c402826753(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 18:59:56 devstack sudo[109274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4 Sep 29 18:59:56 devstack sudo[109274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1572a8-6ce3-41ef-b5a6-b81f11eb5bba]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:56 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:57 devstack sudo[109276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 Sep 29 18:59:57 devstack sudo[109276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:57 devstack sudo[109274]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4" returned: 0 in 0.249s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Lock "cinder-quobyte-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4" released by "delete_volume" :: held 0.679s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Created reservations ['0579f33b-9e02-413e-99a2-5c13eabe4d21', '51673600-517c-4226-a4f3-9f4bbb0ef47f', 'c287f641-ded8-4d85-a260-b70c199fc610', 'bf4b46e7-cab3-4f14-bbc7-0ce7184c42fc'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:57 devstack sudo[109282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:57 devstack sudo[109282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:57 devstack sudo[109276]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753" returned: 0 in 0.376s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:57 devstack sudo[109284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 Sep 29 18:59:57 devstack sudo[109284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:57 devstack sudo[109282]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.280s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:57 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Deleted volume successfully. Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-3060c1b9-3a13-4c24-9e07-cba7edbbbead tempest-ProjectReaderTests-1845436779 None] Lock "cinder-b6042f6f-a5ed-46c0-b099-6a7514f2bbc4-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:57 devstack sudo[109284]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24" returned: 0 in 0.387s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:57 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:57 devstack sudo[109290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24 Sep 29 18:59:57 devstack sudo[109290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:58 devstack sudo[109290]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753.60754bf7-ab09-4c64-9e9b-fc5fec0b2b24" returned: 0 in 0.292s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-60754bf7-ab09-4c64-9e9b-fc5fec0b2b24" released by "_delete_snapshot" :: held 1.597s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-af8eeb57-d191-4cb5-8fa2-c9c402826753" released by "delete_snapshot" :: held 1.634s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Created reservations ['86c92ca7-a4a3-49cc-acef-4329292d2085', 'b412d3dd-747b-40e4-9d30-42981a13ce02', '571b16ad-7cc0-46b4-a22b-03e94b737bb2', '9a3c50fe-b0d9-48ef-b1de-114ec0108aa4'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:58 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Delete snapshot completed successfully. Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-9261b7a1-2eba-4cc7-850d-f3e84095c04a tempest-ProjectMemberTests-1585924540 None] Lock "cinder-60754bf7-ab09-4c64-9e9b-fc5fec0b2b24-delete_snapshot" released by "delete_snapshot" :: held 1.777s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-af8eeb57-d191-4cb5-8fa2-c9c402826753-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-af8eeb57-d191-4cb5-8fa2-c9c402826753-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:58 devstack sudo[109293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:58 devstack sudo[109293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-af8eeb57-d191-4cb5-8fa2-c9c402826753" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-af8eeb57-d191-4cb5-8fa2-c9c402826753" acquired by "delete_volume" :: waited 0.020s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[6686bbf9-f622-48e2-be38-7c69e5857f5a]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:58 devstack sudo[109293]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.275s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:58 devstack sudo[109296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:58 devstack sudo[109296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG oslo_service.periodic_task [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] Running periodic task VolumeManager._thread_info {{(pid=86523) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread count: 28 {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5512}} Sep 29 18:59:58 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-a4ea7cb1-edcc-4626-881c-e54e980ba332 None None] thread info: [<_MainThread(MainThread, started 128671450951808)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86523) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5513}} Sep 29 18:59:59 devstack sudo[109296]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753" returned: 0 in 0.397s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:59 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753 Sep 29 18:59:59 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:59 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-af8eeb57-d191-4cb5-8fa2-c9c402826753" returned: 0 in 0.258s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-af8eeb57-d191-4cb5-8fa2-c9c402826753" released by "delete_volume" :: held 0.769s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Created reservations ['a0a1670b-cb9c-4e94-a101-b5a841aa3756', '8f5ca946-f7bd-4673-863d-adbe720f6de5', '10cc8f0b-8e4e-4a08-9d99-a8cb5ff0a7c0', '737b3f53-9ab4-42c4-8a35-47d751a06a7f'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 18:59:59 devstack sudo[109305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 18:59:59 devstack sudo[109305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 18:59:59 devstack sudo[109305]: pam_unix(sudo:session): session closed for user root Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.252s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 18:59:59 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Deleted volume successfully. Sep 29 18:59:59 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-b6593277-dc46-4cf4-94bb-291e742fb400 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-af8eeb57-d191-4cb5-8fa2-c9c402826753-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (f9d292ff-6bf2-4462-ad93-6ed9bb75aa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5f11de-2bc7-44cf-b329-4f1138740850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd5f11de-2bc7-44cf-b329-4f1138740850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T17:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83393115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225bb696-573d-47b0-8664-eac3d418d574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T17:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T17:00:00Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5504cc9-6cf2-436a-8104-9f935e48f1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5504cc9-6cf2-436a-8104-9f935e48f1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75b980a-e260-4348-9b5b-4f216b161cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d75b980a-e260-4348-9b5b-4f216b161cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '225bb696-573d-47b0-8664-eac3d418d574', 'volume_name': 'volume-225bb696-573d-47b0-8664-eac3d418d574', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7511fa75-c7aa-49d7-b76b-767b2a8e30b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7511fa75-c7aa-49d7-b76b-767b2a8e30b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c659742-ed83-4106-9222-d58531a0082d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:00 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Volume 225bb696-573d-47b0-8664-eac3d418d574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-225bb696-573d-47b0-8664-eac3d418d574', 'volume_size': 1} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T17:00:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-83393115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=225bb696-573d-47b0-8664-eac3d418d574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206bf2bf5e63493db8fc96bbde81948c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T17:00:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T17:00:00Z,use_quota=True,user_id='f732d46d783942f4bfdee427d18df476',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Creating volume 225bb696-573d-47b0-8664-eac3d418d574 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 19:00:00 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:00 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574 1073741824 Sep 29 19:00:00 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:00 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574 1073741824" returned: 0 in 0.413s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:00 devstack sudo[109316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574 Sep 29 19:00:00 devstack sudo[109316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:00 devstack sudo[109316]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574" returned: 0 in 0.247s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] <== create_volume: return (704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.707s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c659742-ed83-4106-9222-d58531a0082d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-225bb696-573d-47b0-8664-eac3d418d574', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:00 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f92058c-6f22-46c6-a5ea-28b914ec3e76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:01 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Volume volume-225bb696-573d-47b0-8664-eac3d418d574 (225bb696-573d-47b0-8664-eac3d418d574): created successfully Sep 29 19:00:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f92058c-6f22-46c6-a5ea-28b914ec3e76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:01 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Flow 'volume_create_manager' (f9d292ff-6bf2-4462-ad93-6ed9bb75aa13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 19:00:01 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-6cbfd6cc-eb6d-4eb3-bdd8-75877947df12 tempest-ProjectMemberTests-1585924540 None] Created volume successfully. Sep 29 19:00:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 19:00:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 19:00:01 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] Creating offline snapshot f7378eae-97a0-400e-a372-187d88dae08a of volume 225bb696-573d-47b0-8664-eac3d418d574 {{(pid=86523) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 29 19:00:01 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84590a7-7a51-4130-a4b1-ac504176fc85]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 19:00:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:01 devstack sudo[109322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574 Sep 29 19:00:01 devstack sudo[109322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:01 devstack sudo[109322]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574" returned: 0 in 0.354s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:01 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a 1G {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:01 devstack sudo[109327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a 1G Sep 29 19:00:01 devstack sudo[109327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:02 devstack sudo[109327]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a 1G" returned: 0 in 0.382s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225bb696-573d-47b0-8664-eac3d418d574 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:02 devstack sudo[109332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225bb696-573d-47b0-8664-eac3d418d574 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a Sep 29 19:00:02 devstack sudo[109332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:02 devstack sudo[109332]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-225bb696-573d-47b0-8664-eac3d418d574 -F qcow2 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a" returned: 0 in 0.313s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:02 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a is being set with open permissions: ugo+rw Sep 29 19:00:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:02 devstack sudo[109339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a Sep 29 19:00:02 devstack sudo[109339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:02 devstack sudo[109339]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a" returned: 0 in 0.249s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:02 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:02 devstack sudo[109344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.info Sep 29 19:00:02 devstack sudo[109344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:02 devstack sudo[109344]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.info" returned: 0 in 0.264s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:03 devstack cinder-volume[86523]: WARNING cinder.volume.drivers.remotefs [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.info is being set with open permissions: ugo+rw Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.info {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:03 devstack sudo[109347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.info Sep 29 19:00:03 devstack sudo[109347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:03 devstack sudo[109347]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.info" returned: 0 in 0.258s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.909s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 19:00:03 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-c472bc7b-7e12-407b-a66c-ac8e46a0fa05 tempest-ProjectMemberTests-1585924540 None] Create snapshot completed successfully Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-f7378eae-97a0-400e-a372-187d88dae08a-delete_snapshot" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-f7378eae-97a0-400e-a372-187d88dae08a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-225bb696-573d-47b0-8664-eac3d418d574" by "delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-225bb696-573d-47b0-8664-eac3d418d574" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-f7378eae-97a0-400e-a372-187d88dae08a" by "_delete_snapshot" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-f7378eae-97a0-400e-a372-187d88dae08a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Deleting offline snapshot f7378eae-97a0-400e-a372-187d88dae08a of volume 225bb696-573d-47b0-8664-eac3d418d574 {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] snapshot_file for this snap is: volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a {{(pid=86523) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a837cf5e-604f-4726-a867-b98d1e1b1bd2]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 19:00:03 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:03 devstack sudo[109389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a Sep 29 19:00:03 devstack sudo[109389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:04 devstack sudo[109389]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a" returned: 0 in 0.376s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:04 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-225bb696-573d-47b0-8664-eac3d418d574(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86523) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 29 19:00:04 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f186fd-f75a-4008-8a09-3509f7e3f259]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 19:00:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:04 devstack sudo[109394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574 Sep 29 19:00:04 devstack sudo[109394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:04 devstack sudo[109394]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574" returned: 0 in 0.368s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:04 devstack sudo[109399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a Sep 29 19:00:04 devstack sudo[109399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:04 devstack sudo[109399]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a" returned: 0 in 0.323s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:04 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:04 devstack sudo[109404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a Sep 29 19:00:04 devstack sudo[109404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:05 devstack sudo[109404]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574.f7378eae-97a0-400e-a372-187d88dae08a" returned: 0 in 0.272s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-f7378eae-97a0-400e-a372-187d88dae08a" released by "_delete_snapshot" :: held 1.432s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 19:00:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-225bb696-573d-47b0-8664-eac3d418d574" released by "delete_snapshot" :: held 1.453s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 19:00:05 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Created reservations ['1456d6a1-f896-46e2-ac87-664ece9aa94b', '2b88401a-dbae-455c-affb-127c02eb5413', '8ee4d3b0-c91e-4281-a99b-a16d45937373', '65444a97-eefc-43af-8740-d0e6042962d9'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 19:00:05 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Delete snapshot completed successfully. Sep 29 19:00:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-47a4006f-20c8-4fd1-8845-005418b05ca7 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-f7378eae-97a0-400e-a372-187d88dae08a-delete_snapshot" released by "delete_snapshot" :: held 1.585s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 19:00:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-225bb696-573d-47b0-8664-eac3d418d574-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 19:00:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-225bb696-573d-47b0-8664-eac3d418d574-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 19:00:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "cinder-quobyte-225bb696-573d-47b0-8664-eac3d418d574" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 19:00:05 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-225bb696-573d-47b0-8664-eac3d418d574" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 19:00:05 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca245206-96f3-4679-a033-9d7cd76bdac1]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 19:00:05 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:05 devstack sudo[109407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574 Sep 29 19:00:05 devstack sudo[109407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:06 devstack sudo[109407]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574" returned: 0 in 0.358s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:06 devstack sudo[109412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574 Sep 29 19:00:06 devstack sudo[109412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:06 devstack sudo[109412]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-225bb696-573d-47b0-8664-eac3d418d574" returned: 0 in 0.249s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-quobyte-225bb696-573d-47b0-8664-eac3d418d574" released by "delete_volume" :: held 0.665s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Created reservations ['f06d56f8-1ccd-4557-a92f-b5ed0fc98f9d', 'a056c505-ffb5-4a25-92ac-e4d15c53c793', 'cdc36cee-c688-443e-9e8f-bce9b7f4f29a', 'e4875619-c00c-4341-94ab-0107cd0610f0'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:06 devstack sudo[109415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 19:00:06 devstack sudo[109415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:06 devstack sudo[109415]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.240s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 19:00:06 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Deleted volume successfully. Sep 29 19:00:06 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-1de997ce-cf99-4ca8-9672-3bca05cb9a00 tempest-ProjectMemberTests-1585924540 None] Lock "cinder-225bb696-573d-47b0-8664-eac3d418d574-delete_volume" released by "delete_volume" :: held 1.104s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 19:00:16 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=85,cinder:INSERT=29,cinder:UPDATE=107,cinder:DELETE=8 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 19:00:16 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=86,cinder:INSERT=34,cinder:UPDATE=117,cinder:DELETE=10 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Flow 'volume_create_manager' (165e6231-dc88-4956-bb9c-276dc45cc3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1f5d3f-3806-480f-801d-531c75e62a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c1f5d3f-3806-480f-801d-531c75e62a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T17:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014933239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ffe2ceaa10482e93c4cccc11d5018a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T17:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T17:00:18Z,use_quota=True,user_id='8175954bda3c4ca7ab254dfae0b4d2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1a5930-a282-48a8-926f-d95a0a0e62e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1a5930-a282-48a8-926f-d95a0a0e62e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c49ef4-aece-4913-bd52-f17da4381bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44c49ef4-aece-4913-bd52-f17da4381bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c', 'volume_name': 'volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375b1770-54d5-4ee3-9878-fccf692c6364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (375b1770-54d5-4ee3-9878-fccf692c6364) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a7ddd0-8c59-44e7-8bec-e9b3bc07655b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:18 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Volume ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c', 'volume_size': 1} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T17:00:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1014933239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ffe2ceaa10482e93c4cccc11d5018a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T17:00:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T17:00:18Z,use_quota=True,user_id='8175954bda3c4ca7ab254dfae0b4d2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Creating volume ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 19:00:18 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:18 devstack sudo[109419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c 1073741824 Sep 29 19:00:18 devstack sudo[109419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:18 devstack sudo[109419]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c 1073741824" returned: 0 in 0.420s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:18 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c Sep 29 19:00:18 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:18 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c" returned: 0 in 0.255s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a7ddd0-8c59-44e7-8bec-e9b3bc07655b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1981410b-0db9-4271-a02f-f414e5e77a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:18 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Volume volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c (ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c): created successfully Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1981410b-0db9-4271-a02f-f414e5e77a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:18 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Flow 'volume_create_manager' (165e6231-dc88-4956-bb9c-276dc45cc3db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 19:00:18 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-b917108e-d1d5-4779-a720-6b4c1bed663a tempest-ProjectReaderTests-886768342 None] Created volume successfully. Sep 29 19:00:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Acquiring lock "cinder-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 19:00:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Lock "cinder-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 19:00:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Acquiring lock "cinder-quobyte-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 19:00:19 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Lock "cinder-quobyte-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c" acquired by "delete_volume" :: waited 0.021s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 19:00:19 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[a405c7e9-1a51-43e6-8869-014f6f49c17c]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 19:00:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:19 devstack sudo[109428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c Sep 29 19:00:19 devstack sudo[109428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:19 devstack sudo[109428]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c" returned: 0 in 0.352s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:19 devstack sudo[109433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c Sep 29 19:00:19 devstack sudo[109433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:19 devstack sudo[109433]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:19 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c" returned: 0 in 0.246s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Lock "cinder-quobyte-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c" released by "delete_volume" :: held 0.639s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Created reservations ['38a5954c-59f6-4b8c-b179-497c0149a625', '0f3ca96b-96aa-4ca5-8aef-d1408d689620', '43756913-852d-49da-a8b4-cdf79a803d4e', '3d7ac40e-0689-4ea0-aa2c-044cd7d34df6'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:20 devstack sudo[109436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 19:00:20 devstack sudo[109436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:20 devstack sudo[109436]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.244s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 19:00:20 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Deleted volume successfully. Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-73a858d4-a02c-4c63-a41a-2dde3cd86020 tempest-ProjectReaderTests-886768342 None] Lock "cinder-ae85b8e9-ed7b-4c63-93d1-5cf94405cc7c-delete_volume" released by "delete_volume" :: held 1.081s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.flows.manager.create_volume [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86523) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Flow 'volume_create_manager' (db1df53e-8d76-4c50-9faa-48627bd8ad46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb02785-1765-437a-af1f-85e376d0d5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb02785-1765-437a-af1f-85e376d0d5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T17:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613370922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e63dd41-86d0-47b1-ab90-d43e15286315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ffe2ceaa10482e93c4cccc11d5018a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T17:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T17:00:21Z,use_quota=True,user_id='8175954bda3c4ca7ab254dfae0b4d2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2fe2da-024f-4b01-b911-5f9b48d95a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2fe2da-024f-4b01-b911-5f9b48d95a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74392ea2-4791-4ae9-8671-8f51318586a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74392ea2-4791-4ae9-8671-8f51318586a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e63dd41-86d0-47b1-ab90-d43e15286315', 'volume_name': 'volume-4e63dd41-86d0-47b1-ab90-d43e15286315', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb686ec2-4c3f-4eed-acc5-565a28434555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb686ec2-4c3f-4eed-acc5-565a28434555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b996b53a-cb48-49d2-9e5d-ee7c124699ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:20 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Volume 4e63dd41-86d0-47b1-ab90-d43e15286315: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e63dd41-86d0-47b1-ab90-d43e15286315', 'volume_size': 1} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-29T17:00:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1613370922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e63dd41-86d0-47b1-ab90-d43e15286315,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a3ffe2ceaa10482e93c4cccc11d5018a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-29T17:00:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-29T17:00:21Z,use_quota=True,user_id='8175954bda3c4ca7ab254dfae0b4d2e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4244d890-b9ae-4d9d-aab7-6bfa1df568b2),volume_type_id=4244d890-b9ae-4d9d-aab7-6bfa1df568b2)}" {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.remotefs [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Creating volume 4e63dd41-86d0-47b1-ab90-d43e15286315 {{(pid=86523) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Selected osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da as target Quobyte volume. {{(pid=86523) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 29 19:00:20 devstack cinder-volume[86523]: INFO cinder.volume.drivers.remotefs [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] casted to osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da Sep 29 19:00:20 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4e63dd41-86d0-47b1-ab90-d43e15286315 1073741824 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:21 devstack sudo[109439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4e63dd41-86d0-47b1-ab90-d43e15286315 1073741824 Sep 29 19:00:21 devstack sudo[109439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:21 devstack sudo[109439]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4e63dd41-86d0-47b1-ab90-d43e15286315 1073741824" returned: 0 in 0.409s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4e63dd41-86d0-47b1-ab90-d43e15286315 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:21 devstack sudo[109445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4e63dd41-86d0-47b1-ab90-d43e15286315 Sep 29 19:00:21 devstack sudo[109445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:21 devstack sudo[109445]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4e63dd41-86d0-47b1-ab90-d43e15286315" returned: 0 in 0.241s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:21 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'} {{(pid=86523) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Sep 29 19:00:21 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 19:00:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b996b53a-cb48-49d2-9e5d-ee7c124699ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e63dd41-86d0-47b1-ab90-d43e15286315', 'volume_size': 1}' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7d219a-8425-442b-9b3b-971d0883d3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 29 19:00:21 devstack cinder-volume[86523]: INFO cinder.volume.flows.manager.create_volume [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Volume volume-4e63dd41-86d0-47b1-ab90-d43e15286315 (4e63dd41-86d0-47b1-ab90-d43e15286315): created successfully Sep 29 19:00:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d7d219a-8425-442b-9b3b-971d0883d3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86523) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 29 19:00:21 devstack cinder-volume[86523]: DEBUG cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Flow 'volume_create_manager' (db1df53e-8d76-4c50-9faa-48627bd8ad46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86523) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 29 19:00:21 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-51c91e9a-9077-4d90-a5cc-8047e749317c tempest-ProjectReaderTests-886768342 None] Created volume successfully. Sep 29 19:00:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Acquiring lock "cinder-4e63dd41-86d0-47b1-ab90-d43e15286315-delete_volume" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 19:00:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Lock "cinder-4e63dd41-86d0-47b1-ab90-d43e15286315-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 19:00:21 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Acquiring lock "cinder-quobyte-4e63dd41-86d0-47b1-ab90-d43e15286315" by "delete_volume" {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Lock "cinder-quobyte-4e63dd41-86d0-47b1-ab90-d43e15286315" acquired by "delete_volume" :: waited 0.015s {{(pid=86523) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG oslo.privsep.daemon [-] privsep: reply[613b23d3-fe22-45ae-a4ec-06cfda8a0322]: (4, 'qcow2') {{(pid=88302) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4e63dd41-86d0-47b1-ab90-d43e15286315 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:22 devstack sudo[109448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4e63dd41-86d0-47b1-ab90-d43e15286315 Sep 29 19:00:22 devstack sudo[109448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:22 devstack sudo[109448]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4e63dd41-86d0-47b1-ab90-d43e15286315" returned: 0 in 0.356s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4e63dd41-86d0-47b1-ab90-d43e15286315 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:22 devstack sudo[109453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4e63dd41-86d0-47b1-ab90-d43e15286315 Sep 29 19:00:22 devstack sudo[109453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:22 devstack sudo[109453]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9/volume-4e63dd41-86d0-47b1-ab90-d43e15286315" returned: 0 in 0.239s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Lock "cinder-quobyte-4e63dd41-86d0-47b1-ab90-d43e15286315" released by "delete_volume" :: held 0.636s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG cinder.quota [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Created reservations ['de6cd155-5e97-4e37-a969-c98ae8d92e1d', '2e6c6482-7333-4772-b712-e8051d1a9131', 'd8b9e31d-f317-48d0-82d1-37d0ba8b6f6a', 'b0dc5d4b-2772-455d-9d81-ccbfb520d745'] {{(pid=86523) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da': None} {{(pid=86523) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG cinder.volume.drivers.quobyte [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-b9a044ea-863d-45cd-aa47-1ccd1079e0da'] {{(pid=86523) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.lockutils [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86523) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 29 19:00:22 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 29 19:00:22 devstack sudo[109456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9 Sep 29 19:00:22 devstack sudo[109456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 29 19:00:22 devstack sudo[109456]: pam_unix(sudo:session): session closed for user root Sep 29 19:00:23 devstack cinder-volume[86523]: DEBUG oslo_concurrency.processutils [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/4783f0c52fc1dd2dd2c33bcca386f2d9" returned: 0 in 0.247s {{(pid=86523) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 29 19:00:23 devstack cinder-volume[86523]: DEBUG cinder.manager [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Notifying Schedulers of capabilities ... {{(pid=86523) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 29 19:00:23 devstack cinder-volume[86523]: INFO cinder.volume.manager [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Deleted volume successfully. Sep 29 19:00:23 devstack cinder-volume[86523]: DEBUG cinder.coordination [None req-4de94bbf-1ee3-47aa-b2ac-4924a315319c tempest-ProjectReaderTests-886768342 None] Lock "cinder-4e63dd41-86d0-47b1-ab90-d43e15286315-delete_volume" released by "delete_volume" :: held 1.074s {{(pid=86523) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 29 19:00:32 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=13,cinder:UPDATE=19,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 19:00:33 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=15,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 19:00:51 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:SELECT=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 29 19:00:51 devstack cinder-volume[86523]: DEBUG dbcounter [-] [86523] Writing DB stats cinder:UPDATE=1 {{(pid=86523) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}